Job Title: T&T | EAD | HCE | Manager | AI Infrastructure On Cloud | Pan India
The Team
Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert them into accurate, actionable information that supports fact-based decision-making and generates an insight-driven advantage. Our practice addresses a wide range of opportunities across business intelligence and visualization, data management, cloud transformation, infrastructure modernization and next-generation technologies, including artificial intelligence, machine learning and high-performance computing.
Your Work Profile
As a Manager in Public Cloud and Hybrid AI Infrastructure, you will architect, engineer and manage production-grade NVIDIA GPU-based AI infrastructure across AWS, Microsoft Azure, Google Cloud and hybrid environments. You will lead the design and deployment of scalable cloud GPU platforms, cloud landing zones, high-performance networking, storage and cloud-native orchestration to support enterprise AI workloads.
-
Design and implement NVIDIA GPU-based AI infrastructure across AWS, Microsoft Azure and Google Cloud, integrating public cloud platforms with private AI infrastructure.
-
Architect secure GPU landing zones, cloud accounts/subscriptions/projects, networking, identity, encryption, private connectivity and observability frameworks.
-
Lead the deployment of cloud GPU clusters using managed Kubernetes, OpenShift and/or Slurm, supporting distributed training, fine-tuning and inference workloads.
-
Design high-performance compute, networking and storage solutions, including data ingestion, checkpointing, caching and cross-region/data-centre connectivity.
-
Build hybrid cloud connectivity and workload portability between private GPU clusters and public cloud environments.
-
Drive infrastructure automation using Terraform, CI/CD, GitOps, image pipelines, autoscaling and cloud resource management.
-
Integrate NVIDIA AI technologies and cloud-native ML services to support scalable AI workloads.
-
Establish GPU performance monitoring, capacity planning, utilization tracking, reliability and cost optimization through AI infrastructure FinOps.
-
Ensure infrastructure security, resilience, workload portability and operational excellence across public cloud and hybrid environments.
-
Lead technical workstreams, engineering teams, design reviews and delivery governance while collaborating with cloud, network, storage, cybersecurity and MLOps teams.
Key Skills Required:
-
Public Cloud and Hybrid AI Infrastructure across AWS, Microsoft Azure or Google Cloud.
-
NVIDIA GPU Architecture, DGX/HGX and Cloud GPU Infrastructure.
-
Cloud GPU Instances, GPU Cluster Design and AI Infrastructure Architecture.
-
Distributed Training, Fine-tuning, RAG, Batch Inference and Real-time Inference.
-
Kubernetes/OpenShift, Slurm, GPU Scheduling, Resource Management and Multi-tenancy.
-
High-Performance Networking, InfiniBand, RoCE and Ethernet.
-
Terraform, Infrastructure as Code (IaC), CI/CD and GitOps Automation.
-
Linux, Containers, CUDA, NCCL, GPU Drivers and Firmware Management.
-
Cloud Storage Architecture, Data Ingestion, Checkpointing and Hybrid Connectivity.
-
GPU Observability, Performance Optimization, Capacity Planning and AI Infrastructure FinOps.
-
Cloud Security, Identity Management, Encryption, Resilience and Day-2 Operations.
-
Technical Leadership, Engineering Team Management and Delivery Governance.
Experience:
-
9+ years of relevant experience in Public Cloud, Hybrid Cloud, Infrastructure Engineering, HPC, SRE or Platform Engineering, including hands-on leadership of AI/GPU infrastructure initiatives.
-
Deep expertise in at least one of AWS, Microsoft Azure or Google Cloud, with working knowledge of other public cloud platforms.
-
Proven experience designing, deploying and managing production-grade NVIDIA GPU infrastructure, cloud GPU clusters and hybrid AI environments.
-
Hands-on experience with cloud GPU instances, high-performance networking, managed Kubernetes/HPC, Infrastructure as Code and cloud cost optimization.
-
Experience leading engineering teams, technical workstreams, cloud infrastructure architecture, automation and delivery governance.
Education:
-
Bachelor's or Master's degree in Computer Science, IT, Engineering or a related field preferred.
-
Professional certifications in AWS, Microsoft Azure, Google Cloud, NVIDIA, Kubernetes, Terraform, Linux or FinOps preferred.
Location and Way of Working:
Pan India | Hybrid