Microsoft
AI & Machine LearningDirect employer career site

Senior Technical Program Manager, AI Infrastructure

Location
Mountain View | United States, CA
Job type
Full-time
Level
Senior
Experience
4+ years
Education
Bachelor's degree
Listed
28 days ago

Skills & highlights for this role

  • distributed systems
  • GPU infrastructure
  • cloud infrastructure fundamentals

Also useful

  • Python
  • machine learning platforms
  • Azure
  • AWS
  • Google Cloud

About the role

We focus on scalability for distributed computing systems, stability of the multi-node GPU infrastructure and efficiency of the fleet to run inference and training workloads. Deliver a world-class AI Infrastructure stack that will host AI Foundry Services.

Accountable for the platform roadmap for platform to scale AI workloads from research to production Own a product area and be responsible for understanding developer needs and behaviors, defining product requirements, managing end-to-end product development, launches and iterations. Find a path to get things done despite roadblocks to get your work into the hands of customers quickly and iteratively.

Enjoy working in a fast-paced, customer-first, product development cycle. Translate business goals into strategy, user experience and technical requirements in close collaboration with UX, Data Science, Engineering, AI research, and Product Marketing teams. Define goals and performance indicators, set up and oversee experiments, measure success with data and research.

Collaborate effectively and communicate clearly with cross-functional teams, including product managers, designers, and other engineers, to build exceptional consumer-grade applications.

Embody our culture and values Bachelor's Degree AND 4+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience 2+ years of experience managing cross-functional and/or cross-team projects.

These requirements include but are not limited to the following specialized security screenings: 8+ years of experience designing and shipping complex products for developers, ML professionals, or similar 3+ years of experience with distributed platform ecosystem (multi-tenant / real-time processing, batch computing etc.) Proven experience in technical program management, preferably in AI infrastructure or cloud services.

Strong understanding of GPUs, VM, OS and cloud infrastructure fundamentals. Excellent communication and stakeholder management skills. Ability to navigate ambiguity and drive clarity across complex, cross-functional initiatives.

Experience creating solutions using Azure, AWS, or Google Cloud Experience writing Python, particularly for machine learning Experience with ML platforms Effective at driving complex multi-stakeholder processes and cross-team programs Ability to build effective relationships, influence and collaborate at all organizational levels

Read the original posting

From Microsoft's careers page, first listed on Rolev.ai on October 11, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Senior Technical Program Manager, AI Infrastructure role at Microsoft, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Senior Technical Program Manager, AI Infrastructure job at Microsoft located?

This Senior Technical Program Manager, AI Infrastructure position at Microsoft is located in Mountain View | United States, CA. Always check Microsoft's application page for specific state eligibility or relocation policies.

What qualifications are required for Senior Technical Program Manager, AI Infrastructure at Microsoft?

For the Senior Technical Program Manager, AI Infrastructure role, Microsoft highlights 4+ years of relevant experience; a bachelor's degree; experience with distributed systems, GPU infrastructure, cloud infrastructure fundamentals. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Senior Technical Program Manager, AI Infrastructure position at Microsoft?

This listing links directly to Microsoft's application page. You can apply directly on Microsoft's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.