Job Title:  Team Lead | Engineering, AI & Data - Engineering | Hadoop

Team Lead | Engineering, AI & Data - Engineering | Hadoop

Location: Mumbai

The team

Engineering helps Reimagine and re-engineer mission-critical operations and processes; Leverage engineering-led design, deep industry knowledge, and AI and data-driven insights to transform the technology platforms at the heart of business.  

Working alongside team, we empower and drive mission-critical solutions whether we need to modernize existing systems or implement new technology products and platforms. Through innovation, we improve financial performance, accelerate new digital businesses and fuel growth. Learn more about Engineering, AI and Data

Your work profile

Responsible for managing and supporting the Hadoop data ecosystem, including cluster administration, performance optimization, and workflow orchestration using Azkaban.

Key skills required

• Education -  Any Bachelor’s or Master’s degree

• Administer and maintain Hadoop cluster (HDFS, YARN, Hive, Spark, etc.)
• Monitor cluster health, performance, and storage utilization
• Manage user access, security (Kerberos), and data governance
• Design, schedule, and manage workflows using Azkaban
• Handle job orchestration, dependencies, and failure recovery
• Monitor job execution, troubleshoot failures, and ensure SLA adherence
• Support development and production issues (L2/L3) related to data pipelines
• Perform capacity planning, patching, upgrades, and system tuning
• Ensure high availability, backup, and disaster recovery readiness
• Maintain documentation, runbooks, and operational processes