Sr Technical Program Manager, AWS Generative AI & ML Servers

About the role

AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help.

You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

Our team designs, builds and operates Amazon's fleet of GPU-accelerated servers using Nvidia's latest GPU offerings to power AI/ML workloads across AWS's compute infrastructure. We solve systemic hardware issues and build hardware and software systems to detect and mitigate future recurrences so that our customers can experience the highest quality of service possible.

AWS Infrastructure Services is seeking a Senior Technical Program Manager to drive end-to-end delivery of GPU-accelerated servers powering AI/ML workloads across our global fleet. You will facilitate requirements gathering with internal customers, coordinate cross-functional engineering teams spanning hardware and software disciplines, manage ODM partnerships across multiple continents, and establish closed-loop quality feedback systems connecting operational data to design improvements.

This role requires technical depth to challenge engineering workstreams and translate technical constraints into program risk, combined with program management excellence to deliver complex hardware at global scale. You will maintain program schedules by identifying blockers early, escalate dependencies before they impact critical path, and ensure our AI/ML infrastructure meets reliability commitments through data-driven quality systems.

Requirements & Planning

• Facilitate requirements gathering sessions with internal customers and stakeholders.
• Work with engineering teams to validate feasibility, identify dependencies, and establish clear success criteria.
• Build program timelines with milestone tracking, critical path analysis, and proactive risk assessment.
• Translate business objectives into program deliverables that engineering teams can execute against.

• Execution & Coordination: Drive cross-functional alignment across hardware, firmware, software, and operations teams to maintain development schedules.
• Manage ODM partnerships by tracking design reviews, manufacturing readiness gates, and quality checkpoints.
• Identify blockers early and escalate dependencies before they impact critical path.
• Facilitate decision-making when teams are stuck on technical trade-offs.
• Communicate program status to stakeholders with clear visibility into progress against milestones.

• Risk & Issue Management: Identify program risks by challenging technical workstreams and connecting technical constraints to schedule impact.
• Escalate risks proactively with quantified business impact and proposed mitigation plans.
• Lead root cause analysis of fleet-wide hardware failures, driving engineering teams to implement corrective actions that improve operational metrics.
• Establish feedback loops connecting operational telemetry back to validation criteria for future designs.

• Quality & Deployment: Define acceptance criteria and coordinate qualification testing across teams.
• Manage deployment readiness by tracking open issues, validating documentation completeness, and ensuring operations teams are prepared for production handoff.
• Facilitate go/no-go decisions with clear risk posture and mitigation status for mission-critical AI/ML workloads.

• Transition & Closure: Conduct knowledge transfer sessions with receiving teams.
• Document lessons learned with actionable recommendations that improve future program execution.
• Ensure all program artifacts are complete and accessible.

A day in the life

Your day-to-day responsibilities will include interfacing with internal and external customers to understand project requirements and facilitate system development on GPU-accelerated server platforms. You will analyze operational challenges across the existing fleet with the goal of improving current customer experience and implementing design improvements for future generations.

You will work directly with ODM partners to coordinate development activities, manage vendor relationships, and drive manufacturing readiness at scale. As the end-to-end owner of complex server platforms, you will lead root cause analysis of fleet issues and implement closed-loop corrective actions that drive improvements back into development processes and design specifications.

Basic Qualifications

• 5+ years of technical product or program management experience
• 7+ years of working directly with engineering teams experience
• Experience managing programs across cross functional teams, building processes and coordinating release schedules
• Experience leading engineering design projects and interacting with cross-functional teams

Preferred Qualifications

• 8+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
• Knowledge of the electrical and mechanical systems involved in critical data center operations including systems such as feeders, transformers, generators, switchgear, UPS systems, ATS units, PDU units, chillers, pumps, air handling units, and CRAC units
• Experience in machine learning, data mining, information retrieval, statistics or natural language processing, or experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
• Experience developing and driving projects with tight schedules and multiple dependencies
• Experience using data and metrics to drive improvements
• Experience coordinating programs with ODM partners across multiple geographies, managing design reviews, manufacturing readiness gates, and quality checkpoints
• Ability communicating program status to executive stakeholders by connecting technical constraints to business impact

Additional information

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Pay and benefits

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

USA, CA, Cupertino - 171,000.00 - 231,400.00 USD annually

USA, WA, Seattle - 148,700.00 - 201,200.00 USD annually