Job Title:  Technology & Transformation - Engineering - Consultant/Senior Consultant - Azure Data Engineer

Role Overview:

We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and solutions on the Azure cloud platform. The ideal candidate should have strong experience in data engineering, ETL processes, and big data technologies.

Key Responsibilities:

• Design and develop data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse, and Azure Storage.
• Implement ETL/ELT processes for structured, semi-structured, and unstructured data.
• Optimize data workflows for performance, scalability, and reliability.
• Collaborate with data scientists, analysts, and business teams to deliver data solutions.
• Ensure data quality, security, and compliance with governance standards.
• Monitor and troubleshoot production data pipelines.
• Maintain documentation for data architecture and processes.

Required Skills:

• Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Data Lake.
• Strong proficiency in PySpark, Python, and SQL.
• Experience with data modeling and data warehousing concepts.
• Familiarity with CI/CD pipelines for data solutions.
• Understanding of Azure services like Azure Synapse, Azure Functions, and Azure Storage.
• Strong problem-solving and analytical skills.