Job Title:  T&T | EAD | CMS | Senior Consultant/Manager | AI Data Center Solution Architect | Pan India

Your potential, unleashed.

India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.

At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters.

The Team

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage.

Job Description:

Experience – 5+ years and 3+ years of relevant experience

Location – Pan India

Education : Any Graduation, B.Tech/B.E, MBA, MCA, BCA

Role Overview

We are looking for an experienced AI Factory / AI Data Center Design Expert with deep expertise in architecting and implementing high-performance, GPU-driven data centers. The candidate will be responsible for architecting scalable, high-throughput AI infrastructure including Passive infra (Power/Cooling) & Active infra (GPU clusters, Storage, Networking, and cloud-native platforms) as part of end-end AI Factory design for Training, Inferencing, RAG, Fine-tuning & Agentic AI use cases

Key Responsibilities

• Design and implement AI-focused Data Center (DC) architectures aligned with Tier II / Tier III/Tier IV standards
• Develop end to end solutions for DC including retrofitting of existing CPU DC to futuristic AI Factories
• Ability to create DC RFPs as part of Advisory and also produce technical and financial proposals based on customer RFPs for AI DC solutions
• Ability to create AI Infra solutions across Hyperscaler (AWS, Azure, GCP, OCI) and Nvidia Cloud Partners (Yotta, Sify etc.,)
• Architect and deploy InfiniBand and NVIDIA Spectrum Ethernet fabrics for AI workloads
• Lead GPU cluster design, sizing, and implementation for AI/ML use cases
• Perform GPU capacity planning and requirement estimation based on workload profiling
• Implement and manage NVIDIA UFM (Unified Fabric Manager) and NetQ for monitoring and fabric visibility
• Configure and optimize NetQ telemetry, validation, and troubleshooting workflows
• Design and implement Leaf-Spine switching architectures, EVPN-VXLAN based overlay networks
• Lead Cumulus Linux-based network deployments and automation
• Implement and manage OpenShift, VMware Tanzu-based container platforms for AI workloads
• Deploy and integrate RUN:AI and Slurm workload schedulers for GPU orchestration
• Ensure seamless integration of AI Data Center with existing enterprise DC environments
• Optimize network latency, throughput, and congestion control for AI workloads
• Drive performance benchmarking, tuning, and capacity planning for AI infrastructure
• Support design validation, POCs, and production rollouts

Technical Skills Required

Passive Infrastructure

• Good understanding of DC Power chain (Transformers, Generators, ATS, Switchgear, UPS, PDU/RPPs etc.,) and ability to calculate power requirements for DC
• Good understanding of DC Cooling requirements (Air-cooling, Water cooling, CRAC/CRAH, Chillers, Liquid Cooling (DLC, Immersion). Ability to calculate Cooling requirements (Refrigeration Tons) based on the DC power requirements
• Rack design, Rack drawings, DC white space requirements, Passive cabling (Fiber, Copper)
• Basic understanding of Raised floors, Ceiling, Plenum, fire systems and other DC requirements

AI Networking & Fabric

• Strong expertise in InfiniBand (HDR/NDR), RoCE, and Ethernet fabrics
• Hands-on with NVIDIA Spectrum switches
• Deep knowledge of EVPN-VXLAN, BGP, ECMP, Spine-Leaf architecture
• Experience with Cumulus Linux

AI Compute

• GPU cluster design (NVIDIA H100/H200/B200/B300/DGX /AI Factory etc)
• Understanding of MIG (Multi-Instance GPU), GPU virtualization
• AI workload characteristics (training vs inference)

AI Storage

• Understanding of AI storage systems (parallel file systems like Lustre, GPFS – good to have)
• Working knowledge of various storage technologies (NFS, iSCSI, Fibre-channel, NVMe, NAS/Block/Object Storge etc.,)
•  

Orchestration & Platforms

• Experience with RUN:AI, Slurm workload manager
• Kubernetes ecosystem, preferably VMware Tanzu, OpenShift
• Container networking for AI workloads

AI Monitoring, Management and Observability

• NVIDIA UFM (Unified Fabric Manager), NVIDIA Mission Control
• NetQ for fabric telemetry and troubleshooting
• Exposure to DC observability tools

AI Infra Software Layer

• Working knowledge of various software layers of AI Infra not limited to
• LLM Models
• MLOps,
• Training & Inference components
• Agentic AI
• NVIDIA AI Enterprise
• NVIDIA Licensing
• NVIDIA NVIS

Cloud and Hyperscalers

• Working knowledge of various Cloud technologies and ability to build solutions on Hyperscalsers such as AWS, Azure, GCP, OCI etc.,
• Understanding of AI services across various environment

Others

• Preparing HLDs, LLDs, Network diagrams, rack diagrams
• Preparation of BOQs, TCO Calculators, Training collaterals
• Tokenomics and pricing knowledge for designing solutions for AI use cases

Qualifications & Trainings

• Bachelor’s/master’s in computer science, Engineering, or related field
• Relevant certifications in networking, cloud, or NVIDIA ecosystem (preferred)

Other Key Competencies

• Strong architectural thinking and problem-solving skills
• Ability to handle end-to-end design to implementation ownership
• Excellent communication and stakeholder management
• Experience working in large-scale enterprise or hyperscale environments
• Willingness to travel for client meetings, workshops and seminars

How you’ll grow

Connect for impact

Our exceptional team of professionals across the globe are solving some of the world’s most complex business problems, as well as directly supporting our communities, the planet, and each other. Know more in our Global Impact Report and our India Impact Report.

Empower to lead

You can be a leader irrespective of your career level. Our colleagues are characterised by their ability to inspire, support, and provide opportunities for people to deliver their best and grow both as professionals and human beings. Know more about Deloitte and our One Young World partnership.

Inclusion for all

At Deloitte, people are valued and respected for who they are and are trusted to add value to their clients, teams and communities in a way that reflects their own unique capabilities. Know more about everyday steps that you can take to be more inclusive. At Deloitte, we believe in the unique skills, attitude and potential each and every one of us brings to the table to make an impact that matters.

Drive your career

At Deloitte, you are encouraged to take ownership of your career. We recognise there is no one size fits all career path, and global, cross-business mobility and up / re-skilling are all within the range of possibilities to shape a unique and fulfilling career. Know more about Life at Deloitte.

Everyone’s welcome… entrust your happiness to us                                                                                                                                        

Our workspaces and initiatives are geared towards your 360-degree happiness. This includes specific needs you may have in terms of accessibility, flexibility, safety and security, and caregiving. Here’s a glimpse of things that are in store for you. 

Interview tips

We want job seekers exploring opportunities at Deloitte to feel prepared, confident and comfortable. To help you with your interview, we suggest that you do your research, know some background about the organisation and the business area you’re applying to. Check out recruiting tips from Deloitte professionals.