Technical Program Manager, Compute Infrastructure
OpenAI
San Francisco, United States · Remote
Posted 11 hours ago
OpenAI has sponsored H-1B visas
15 approvals in FY2022 · 12 approvals in FY2021. USCIS data. Past approvals don't guarantee this role sponsors.
Via OpenAI careers. This posting does not say whether it sponsors visas. Check the details on the employer's page before applying.
About the role
About the Team
The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation of models. We provide a unified platform for OpenAI teams to run production Applied AI and Research training workloads.
Our work spans cloud providers, bare metal infrastructure, data centers, and the foundational services that make compute usable. We partner across Engineering, Research, Product, Capacity Planning, Finance, and Data Center Infrastructure to bring new capacity online and support OpenAI’s growing compute needs.
We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.
About the Role
As a Technical Program Manager for Compute Infrastructure, you will own the supply signal for all GPUs entering our fleet: a reliable view of what capacity is arriving, where and when it will arrive, and when it is expected to become usable. You will own the roadmap, requirements, delivery, and adoption of the tools, data, and platform behind that signal, partnering with Engineering to build systems that support planning and execution across OpenAI.
You will also lead programs that turn incoming supply into usable compute. Working across cloud providers, Data Center Infrastructure, and compute engineering teams, you will connect physical site readiness with the CPU, storage, network, GPU, and foundational services required to bring new sites and clusters online.
You will be part of an engineer-first TPM team, managing a broad portfolio of infrastructure programs and making dependencies, risks, and decisions clear from working teams through leadership. Your work will help teams plan with confidence, respond to supply changes, and deliver capacity on time.
In this role, you will:
Own the GPU supply signal across the fleet. Maintain a trusted view of incoming capacity across providers, sites, and clusters, including quantities, delivery forecasts, acceptance and readiness milestones, and expected dates for production use. Make changes and their downstream effects visible.
Build and scale the tools, data, and platform behind that signal. Own the roadmap, requirements, delivery, and adoption, partnering with Engineering on data models, integrations, quality checks, and planning workflows. Serve Product TPMs, Capacity TPMs, and Compute TPMs, alongside Finance, Accounting, leadership, Engineering, and Research.
Connect supply with capacity planning. Partner with Capacity Planning on supply and demand management, allocation planning, and scenario analysis. Ensure plans reflect current supply forecasts, infrastructure constraints, and the effects of early or late deliveries.
Coordinate physical readiness for new capacity. Work closely with Data Center Infrastructure and cloud service providers to align ready-for-service dates, site construction, power and cooling readiness, supply-chain convergence, equipment delivery, and commissioning. Track dependencies and drive resolution of gaps that threaten deployment.
Lead logical readiness across infrastructure resources. Coordinate CPU, storage, network, GPU, Kubernetes, and dependent compute foundation services so new clusters can support their intended workloads. Make clear which missing services or resources could delay GPU use.
Drive deployment across cloud and bare metal environments. Lead integrated plans across AWS, GCP, Azure, OCI, and other infrastructure partners, accounting for provider-specific dependencies while establishing consistent readiness criteria and handoffs.
Establish Delivery Scorecards for cloud providers and internal infrastructure teams. Track delivery commitments, forecast changes, actual delivery, readiness milestones, and time to usable capacity. Use these scorecards to identify recurring gaps, clarify recovery actions, and improve delivery predictability.
Improve the reliability and repeatability of cluster bringup. Partner with Engineering to scale automation, runbooks, validation, and deployment processes. Reduce manual coordination and the time between capacity delivery and production use.
Manage the critical paths across concurrent programs. Establish clear milestones, owners, dependencies, and escalation paths. Resolve cross-team blockers and drive decisions that keep site and cluster deployments moving.
Communicate progress, risks, and tradeoffs clearly. Give technical and business stakeholders the information they need to understand capacity availability, assess changes to the plan, and make timely decisions.
You might thrive in this role if you:
Have 5+ years of experience leading major technical programs, including compute infrastructure, hyperscaler deployments, capital projects, or similarly complex infrastructure work.
Possess a degree in a hard science or engineering discipline, or have a demonstrated track record of equivalent engineering expertise.
Are familiar with Kubernetes deployments and have worked with at least one major cloud provider—such as AWS, GCP, Azure, or OCI—to scale compute infrastructure. Experience coordinating deployments across multiple providers is valuable.
Are familiar with bare metal GPU capacity and the provisioning, inventory, and planning systems used to bring it into service.
Have worked with Capacity Planning teams on supply and demand management, allocations, constraints, and supporting tools. You understand how changes in delivery or readiness affect downstream capacity plans.
Have experience defining requirements for operational data and internal platforms. You can work with engineers to establish useful data models, improve data quality, and build tools that teams adopt and rely on.
Understand how site readiness, power and cooling, equipment delivery, commissioning, and ready-for-service milestones affect cluster deployment. You can coordinate these dependencies without losing sight of when the intended workload can run.
Have a record of owning and delivering complex technical programs across internal teams and external partners, including cloud providers, equipment suppliers, or data center infrastructure teams.
Are technically adept and comfortable working with Engineering and Research to understand dependencies, evaluate tradeoffs, and turn complex problems into executable plans.
Build simple, scalable processes and communicate clearly with both technical teams and business stakeholders. You are resourceful in ambiguous environments and follow issues through to resolution.
Are interested in and thoughtful about the impacts of AGI.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Sign in to see the full job
Create a free account to read the full description, apply, and save jobs.