Job Title:  Director | AI / ML | Delhi | Engineering | Hybrid Cloud Engineering

Director | AI / ML | Delhi | Engineering | Hybrid Cloud Engineering
• Job requisition ID : 111374 
• Location: Delhi
• Entity: Deloitte Touche Tohmatsu India LLP 

The Team

The team drives large-scale mainframe modernization and enterprise transformation for Tier-1 global banks. It combines deep technical expertise with business development and delivery leadership to modernize legacy platforms, accelerate cloud adoption, and build future-ready digital capabilities for global financial institutions.

Your work profile

  • Build and maintain on-premise GPU infrastructure, including NVIDIA DGX systems, GPU clusters, and storage.

  • Configure GPU scheduling, resource quotas, and multi-instance GPU (MIG) using Kubernetes or Run.

  • Deploy and optimize model serving platforms such as vLLM, Triton, and TensorRT-LLM.

  • Manage containerization, networking, access controls, and security monitoring for AI workflows.

  • Provide self-service AI development environments using Jupyter and Kubeflow.

    Key skills required: 

  • Full-time Bachelor's degree in Engineering with 15+ Years of Exp

  • 4–8+ years of experience in DevOps, SRE, or AI infrastructure operations.

  • Strong expertise in Linux administration, Docker, and Kubernetes.

  • Hands-on experience with NVIDIA CUDA, NCCL, and GPU performance tuning.

  • Familiarity with model serving runtimes, MLflow, Kubeflow, or Red Hat OpenShift AI.

  • Proficiency in Python and infrastructure automation tools such as Terraform and Ansible.