Job Title:  Technology & Transformation - Engineering - Senior Consultant - AWS Data Engineer

Job Title: Software Engineer – Data Engineering

Experience: 6+ Years

Open Positions: 15

Location: Bengaluru / Hyderabad

Work Model: Hybrid – Mandatory 3 days/week from client office

About the Role

We are looking for skilled Data Engineers to join a high visibility datastore migration program. The selected candidates will be part of the Datastore Migration Factory Team, responsible for end-to-end migration from on-prem Data Lake to AWS-hosted Lakehouse architecture.

This role involves pipeline migration, data transformation, reconciliation, and stakeholder engagement to ensure seamless migration and functional equivalence of production data assets.

Key Responsibilities

• Migrate data pipelines from legacy/on-prem Data Lake environments to AWS-hosted Lakehouse
• Refactor and migrate extraction logic, scheduling workflows, and ingestion frameworks
• Build and optimize data ingestion pipelines
• Convert and optimize legacy SQL/Spark-based consumption patterns for Snowflake and Iceberg
• Ensure data integrity, reconciliation, and quality validation during migration
• Work closely with internal stakeholders for data handoff, sign-off, and migration validation
• Collaborate with platform and data management teams to adopt new workflows and technologies
• Analyze usage patterns to deliver optimized and scalable data products

Must Have Skills

• 6+ years of strong hands-on development experience
• Experience in AWS Cloud with on-prem to Lakehouse migration
• Strong expertise in building ingestion pipelines
• Strong proficiency in SQL and coding skills in Python
• Strong understanding of:
• SCDs (Slowly Changing Dimensions)
• Milestoning / Temporal Data Modeling
• Data Lineage
• Data Lake concepts
• Schema Evolution & Enforcement
• Data Partitioning & Clustering
• Experience with Spark
• Familiarity with CI/CD practices and SDLC
• Basic troubleshooting and scripting experience

Good to Have Skills

• Experience with Kafka
• Exposure to Hadoop (HDFS/Hive)
• Knowledge of Sybase IQ
• Experience with Kubernetes (K8s) deployments
• Familiarity with data formats such as JSON, Avro, and Parquet
• Hands-on experience with Snowflake and Apache Iceberg
• Understanding of Normalization vs Denormalization, Natural vs Surrogate Keys

Educational Qualification

Bachelor’s or master’s degree in computer science, Engineering, Applied Mathematics, or a related quantitative field.

Key Competencies

• Strong ownership and delivery mindset
• Excellent stakeholder management and communication skills
• Ability to work effectively with global teams across time zones
• Strong problem-solving skills and learning agility
• High integrity, collaboration, and professionalism