Job Title:  Technology and Transformation - Engineering - Senior Consultant - AWS Data Engineer - Bengaluru

The Team

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning. 

Your work profile

We are looking for skilled Data Engineers to join a high visibility datastore migration program. The selected candidates will be part of the Datastore Migration Factory Team, responsible for end-to-end migration from on-prem Data Lake to AWS-hosted Lakehouse architecture. This role involves pipeline migration, data transformation, reconciliation, and stakeholder engagement to ensure seamless migration and functional equivalence of production data assets.

Key Skills & Competencies

• Migrate data pipelines from legacy/on-prem Data Lake environments to AWS-hosted Lakehouse
• Refactor and migrate extraction logic, scheduling workflows, and ingestion frameworks
• Build and optimize data ingestion pipelines
• Convert and optimize legacy SQL/Spark-based consumption patterns for Snowflake and Iceberg
• Ensure data integrity, reconciliation, and quality validation during migration
• Work closely with internal stakeholders for data handoff, sign-off, and migration validation
• Collaborate with platform and data management teams to adopt new workflows and technologies
• Analyze usage patterns to deliver optimized and scalable data products

• 6+ years of strong hands-on development experience
• Experience in AWS Cloud with on-prem to Lakehouse migration
• Strong expertise in building ingestion pipelines
• Strong proficiency in SQL and coding skills in Python
• Strong understanding of: SCDs (Slowly Changing Dimensions), Milestoning / Temporal Data Modeling, Data Lineage, Data Lake concepts, Schema Evolution & Enforcement, Data Partitioning & Clustering.
• Experience with Spark
• Familiarity with CI/CD practices and SDLC
• Basic troubleshooting and scripting experience

• Experience with Kafka
• Exposure to Hadoop (HDFS/Hive)
• Knowledge of Sybase IQ
• Experience with Kubernetes (K8s) deployments
• Familiarity with data formats such as JSON, Avro, and Parquet
• Hands-on experience with Snowflake and Apache Iceberg
• Understanding of Normalization vs Denormalization, Natural vs Surrogate Keys

Preferred Qualifications

• Education - B. tech / BE in Computer Science or Information Technology.

Success Metrics

• 6+ years of strong hands-on development experience
• Experience in AWS Cloud with on-prem to Lakehouse migration
• Strong expertise in building ingestion pipelines
• Strong proficiency in SQL and coding skills in Python
• Data Lineage
• Data Lake concepts
• Schema Evolution & Enforcement
• Data Partitioning & Clustering
• Experience with Spark

• Familiarity with CI/CD practices and SDLC

• Basic troubleshooting and scripting experience

Location and way of working:

• Location: Bengaluru / Hyderabad

• Work Model: Hybrid – Mandatory 3 days/week from client office