Job Title:  T&T| Azure Data Engineer | Manager | Bengaluru

The Team 

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.

Experience: 10 - 15 years

Education: Btech/BE/MBA

Mandatory Skills:

Databricks, Pyspark, SQL,Python, Azure Functions, Live / Streaming / batch processing data, Azure Data Factory (ADF), Logic Apps, Azure Functions

ELT / ETL, Data Modelling, Data Integration & Ingestion, Data Manipulation and Processing, GITHUB, Action, Azure DevOps

Optional skills:

Experience in project management, running a scrum team.

Exposure to working with external technical ecosystem.

Your Work Profile 

• Design and implement scalable, secure, and high-performance data architectures on Azure.
• Design, develop, and optimize ETL/ELT data pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.
• Implement data ingestion, transformation, and storage solutions using Azure Data Lake, Azure SQL, and Azure Synapse.
• Develop batch and real-time data processing solutions using Azure services like Delta Live Tables, Event Hubs, Stream Analytics, and Azure Functions.
• Development experience as a data engineer with focus on core tools and technologies like ADF, Databricks, Key Vault, ADLS, SQL Server / Any RDMS, Fabric, Azure Synapse. 
• Strong SQL and Python skills for data transformation and analysis.
• Design and implement data models, schemas, and performance-optimized queries.
• Work with structured, semi-structured, and unstructured data sources.
• Ensure data quality, governance, and security in all solutions.
• Deploy data solutions using Azure DevOps CI/CD pipelines.
• Work closely with data scientists, analysts, and business users to support data-driven decision-making.
• Troubleshoot and optimize data workflows for scalability and performance.
• Ensure data solutions are cost-optimized, scalable, and secure on Azure.
• Implement logging, monitoring, and alerting solutions using Azure Monitor and Log Analytics

Secondary skills:

• Project management – status reports, stand up, knowledge on Agile methodology
• Stake holder management
• Mentor data engineers and analysts
• Provide technical direction and design reviews
• A determined focus on the user and user experience when problem- solving
• Team player and able to collaborate, proactively communicates and shares understanding and experience within a team 
• Clear communicator and able to work in a multicultural/lingual environment 
• Uses initiative and owns their deliverables end-to-end 
• Brings ideas to the table, is inquisitive and excited by new technology  
• Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items 
• Provides regular, considered feedback and regularly strives to improve their own ways of working

Soft Skills:

• Engage with business leaders, developers, infra, and security teams
• Understand business requirements deeply
• Manage expectations and negotiate priorities
• Self-starter and proactive to provide cost and performance-oriented solutions.                                                                     

Preferred Qualification:

• Bachelor’s degree in computer science, information technology, management information systems or equivalent work experience
• Experience working in regulated environments and with internal systems quality policies and procedures.
• Experience in development and deployment on cloud infrastructure.
• Azure Certifications (Azure Data Engineer Associate, Azure Solutions Architect).
• Databricks Certification

Location and Way of Working 

• Base location: Bangalore (Work From Office)

Your role as Manager

At Deloitte India, we believe in the importance of leadership at all levels. We expect our people to embrace and live our purpose by challenging themselves to identify issues that are most important for our clients, our people, and for society and make an impact that matters. In addition to living our purpose, Consultant across our organization: Develop high-performing people and teams through challenging and meaningful opportunities
Deliver exceptional client service; maximize results and drive high performance from people while fostering collaboration across businesses and borders Influence clients, teams, and individuals positively, leading by example and establishing confident relationships with increasingly senior people Understand key objectives for clients and Deloitte; align people to objectives and set priorities and direction. Acts as a role model, embracing and living our purpose and values, and recognizing others for the impact they make