Job Title: T&T | EAID | Engineering | Data Engineering - AWS | Senior Consultant | Hyderabad

T&T | EAID | Engineering | Data Engineering - AWS | Senior Consultant | Hyderabad
• Job requisition ID : 115243
• Location: Hyderabad
• Entity: Deloitte Touche Tohmatsu India LLP
The Team
Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
Your work profile
You will be responsible for analyzing, designing, developing, implementing, and testing large-scale Big Data applications across batch processing and API-based workloads on AWS Cloud. You will build scalable and reliable data solutions, optimize application performance, troubleshoot complex technical issues, and ensure efficient data processing. You will also develop and maintain REST and SOAP integrations, implement and manage CI/CD pipelines, and collaborate with cross-functional teams to deliver high-quality solutions. Exposure to Snowflake-based data ingestion and transformation automation, along with DevOps practices, will be an added advantage
Key skills required
- 7 to 9 years of experience in Big Data application analysis, development, implementation, and testing on AWS Cloud.
- Strong hands-on coding experience in Java and PySpark (both are mandatory).
- Experience developing and supporting both batch processing applications and API-based workloads.
- Experience developing and integrating REST APIs and SOAP web services.
- Hands-on experience with AWS services, including: Amazon EMR, EC2, ECS, and S3, AWS API Gateway, AWS Step Functions, Airflow for workflow orchestration
- Experience with Big Data technologies such as Spark, Hadoop, HDFS, MapReduce, and Cassandra.
- Strong understanding of distributed data processing and batch application performance tuning
- Hands-on experience creating and maintaining CI/CD pipelines using Maven, Gradle, Jenkins, Artifactory, AWS CodeCommit, and CloudFormation.
Nice-to-have
- Experience with Snowflake, particularly in developing automated data ingestion and transformation pipelines using Spark
- Knowledge of DevOps practices and source code management tools such as Git, GitHub, Bitbucket, and GitLab
- Familiarity with development tools such as IntelliJ IDEA and PyCharm
- Additional programming experience in Scala, Kotlin, or Python
Education:
- B. Tech / M. Tech; B.E / M.E; B.Sc. / M.Sc.; B. Com / M.com; MBA/PGDM; BCA/MCA; PHD
Location and Way of Working:
- Base location: Hyderabad
