Job Title: Manager | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration
• 6–8 years of experience in data engineering.
• Strong hands-on experience with Databricks on AWS.
• Strong experience with PySpark and large-scale data processing.
• Proven experience designing and implementing ETL/ELT pipelines in AWS.
• Solid experience with AWS services such as S3, EC2
• Strong SQL and data warehousing concepts; experience with orchestration tools (e.g., Databricks Jobs) preferred.
• Strong experience in performance tuning and optimization of PySpark/Databricks jobs.
• Hands-on experience with monitoring and logging for data pipelines (e.g.Databricks workflows logs).
• Exposure to data quality frameworks and practices (validation, reconciliation, error handling).
• Experience conceptualizing and delivering PoCs and converting them into scalable production-ready solutions.
• Willing to work in 2nd shift and Hybrid mode.