Senior Datacenter Technical Program Manager, At-Scale AI Clusters
Stay safe on Roleway
Never send money to companies. Jobs on Roleway never require payment from applicants.
NVIDIA is looking for a highly-motivated Technical Program Manager (TPM) to join our Applied Systems Engineering Team to drive datacenter integration for the next generation of NVIDIA AI supercomputing systems. This TPM will play a crucial role throughout the lifecycle of the latest AI systems at scale, from datacenter design and requirements definition, through systems integration of AI clusters into the datacenter environment, and support for these systems as they enter production.
This role will drive collaboration between engineering leaders across multiple hardware and software teams, helping us work together to build AI supercomputers for NVIDIA engineers and develop reference architectures to advise customers and partners.
What you’ll be doing:
- Collaborate with outstanding engineers and architects to build and deploy large scale GPU computing systems based on NVIDIA's reference supercomputing architectures
- Lead the integration of new AI clusters with datacenter facilities with demanding requirements on power, cooling, and instrumentation
- Coordinate design and fit-out of new datacenter builds, working with both internal engineering teams and external contractors
- Own and produce detailed documentation for the end-to-end process for datacenter fit-out and integration
- Communicate internally with engineering leadership to prioritize and address key issues essential to the success of our largest customers
What we need to see:
- BS in Applied Science or Engineering (or equivalent experience)
- 8+ years of overall experience
- Experience with high-performance computing systems and GPU clusters deployed in on-premises datacenters
- A passion for understanding challenging technical problems and driving the process of finding a solution
- Strong teamwork and interpersonal skills, to facilitate building a collaborative workflow for coordination between many teams
Ways to stand out from the crowd:
- Understanding of datacenter design, including familiarity with power and cooling technologies
- Expertise in system monitoring and instrumentation of large clusters, using technologies such as Prometheus, Grafana, Splunk, Modbus, and BACNet
- Experience working with the engineering or academic research community supporting high-performance computing or deep learning
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until August 4, 2026.This posting is for an existing vacancy.NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas
Apply now
Please let NVIDIA know you found this job on Roleway. This helps us grow!
About NVIDIA
Learn more about NVIDIA and their company culture.
Computing company known for GPUs and the hardware and software that power gaming, AI and data centers.
Employee benefits
Perks offered with this role.
- Equity
Similar remote jobs
Here are other jobs you might want to apply for.
Director, Semiconductor Supply Chain Management
Temp - Field Operations Specialist
Director, Regulatory Affairs Labeling
Trade Operations Manager - APAC
Global Compensation Lead
Senior Operations Manager
122 more remote jobs at NVIDIA
Explore the open remote roles at NVIDIA.
Senior Linux Systems Engineer - EDA Infrastructure
Senior Solution Architect, AI Infrastructure
Senior System Software Engineer, Automotive Performance
CPU Design Methodology Engineer
Senior System Software Engineer - GPU Power Management
Engagement Tech Lead, Agentic AI
Remote companies like NVIDIA
Find your next opportunity by exploring companies similar to NVIDIA.
Tsmg
Field data collection company that gathers on-the-ground data in places where automation can't do the job.
Openai
AI research and deployment company behind ChatGPT, the GPT models and the OpenAI API.
Welo Global
Multilingual content and AI data services group behind Welocalize and Welo Data, working with linguists and annotators worldwide.
Samsara
Connected operations platform that uses IoT sensors, video and AI to help fleets and physical industries run safely and efficiently.
GitLab
All-remote DevOps platform that covers source control, CI/CD and security in a single application.
Affirm
Fintech company offering buy now, pay later loans at checkout with clear, upfront pricing.