Job Title:  Technology & Transformation- Engineering- ADMM- GCP - Manager

The team

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.       

Job Description:

•  5 to 9 Years of experience.
• Design, develop, and maintain scalable and reliable ETL/ELT pipelines using PySpark.
• Develop and manage data solutions on GCP services such as BigQuery, Cloud Storage, Dataflow, and Dataproc.
• Write efficient, optimized, and complex queries using SQL for data transformation and analysis.

Key skills required: 

•  Build and manage workflow orchestration using Apache Airflow, ensuring reliable scheduling and monitoring of data pipelines.
• Ensure data quality, integrity, and governance across all data pipelines.
• Implement performance tuning and optimization techniques for large-scale data processing.
• Monitor, troubleshoot, and resolve data pipeline issues in production environments.
• Follow best practices in data engineering, including version control, CI/CD, and code reviews

Preferred Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Location and Way of Working: 

• Base location: Banglore