We are seeking a highly skilled and motivated Senior Data Engineer with a strong focus on the Microsoft Azure tech stack. The ideal candidate will have a deep understanding of data architecture, data modeling, and data processing, with a proven track record of leveraging Azure services to build robust, scalable data & analytics solutions for the purpose of delivering AI, machine learning, and data visualization solutions for mid-market and enterprise organizations.

Responsibilities

• Design, build, and maintain data pipelines in Azure, using services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.
• Implement data storage solutions using Azure Blob Storage, Azure Data Lake, and Azure Cosmos DB.
• Develop and optimize data processing algorithms and data sets to support data analytics and machine learning initiatives.
• Work closely with data scientists, analysts, and other stakeholders to understand data needs and implement solutions.
• Ensure data quality and integrity using Azure Purview and other data governance tools.
• Monitor and troubleshoot data pipelines, implementing fixes and improvements as needed.
• Stay up to date with the latest Azure services and technologies, and advocate for their adoption where appropriate.
  
  

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or a related field. Advanced degree preferred.
• 5+ years of experience in data engineering using the Azure tech stack.
• Proficiency in SQL and experience with Python and/or another scripting language.
• Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.
• Knowledge of data warehousing concepts and best practices.
• Strong problem-solving skills and the ability to work independently and in a team.
• Excellent English communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.