Microsoft
Direct employer career site

Senior Software Engineer, AI Infrastructure

Pay
$119,800 – $234,700 per year
Location
Redmond, WA · On-site
Job type
Full-time
Level
Lead / Staff
Experience
4+ years
Education
Bachelor's degree
Listed
Today

Skills & highlights for this role

  • distributed systems
  • C#
  • Java
  • Go
  • software design
  • code review
  • automated testing

Also useful

  • AI model serving
  • GPU resource management
  • cloud infrastructure
  • feature flags and gradual rollouts
  • on-call reliability engineering
  • technical mentorship

Overview

Every time someone uses Azure OpenAI Service, their request needs to reach the right graphics processing unit (GPU), in the right region, at the right moment. Our team makes that happen. We build the platform that decides how AI traffic flows across Microsoft's global infrastructure, so services like Azure OpenAI and Microsoft Copilot stay fast and reliable. You'll join a supportive, connected team that keeps these experiences fair and dependable for every customer while making the most of every GPU we run.

As a Senior Software Engineer, AI Infrastructure on our team, you'll design, build, and run services that route and prioritize AI requests and match them to available computing capacity. You'll own the design of key parts of our platform, work with partner teams to bring new AI models and capabilities to customers, and help keep our services healthy in production. This opportunity will allow you to deepen your knowledge of distributed systems at global scale, learn how the world's leading AI models are served, and grow as a technical leader and mentor on your team.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

  • Design - Own the design of key parts of our platform for routing AI traffic and managing computing capacity. Write design proposals, compare options, and make sure designs meet goals for speed, reliability, scale, and cost.
  • Coding - Write clear, secure, well-tested code and set a good example for the team. Give thoughtful, timely code reviews that help others grow.
  • Implement - Break work into clear, dependable milestones with program managers. Use feature flags and gradual rollouts to test changes safely, measure their impact, and roll back quickly when needed.
  • Reliability and Supportability - Take part in the on-call rotation as a designated responsible individual (DRI). Add monitoring and dashboards, improve troubleshooting guides, and help reduce how often incidents happen.
  • Understand User Requirements - Work with product managers and partner teams to understand what customers need and turn those needs into clear technical requirements.
  • Engineering Excellence - Build security, privacy, and compliance into every stage of your work, from design to deployment. Automate testing and releases, and share what you learn with the team.
  • AI-Native Development - Use artificial intelligence (AI) tools across the software development lifecycle (SDLC), from writing code and tests to investigating live issues. Take responsibility for AI-generated work and help teammates do the same.
  • Embody our Culture and Values

Required Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR equivalent experience.

Other Requirements

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR Bachelor's Degree in Computer Science or related technical field
  • AND 8+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR equivalent experience.
  • 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
  • 2+ years of experience with systems that route or schedule traffic, or that allocate computing resources.
  • Experience with Python, Docker, and Kubernetes.
  • Experience with AI or machine learning (ML) infrastructure, such as serving models in production or managing GPU fleets.
  • Experience delivering projects with partner teams, from design through launch and operation.
  • Experience being on call for highly available services and improving monitoring to reduce incidents.

#AIINFRA

Pay and benefits

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Read the original posting

From Microsoft's careers page, first listed on Rolev.ai on November 15, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Senior Software Engineer, AI Infrastructure role at Microsoft, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

What is the salary for the Senior Software Engineer, AI Infrastructure role at Microsoft?

The Senior Software Engineer, AI Infrastructure posting at Microsoft states compensation of $119,800 – $234,700 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Microsoft's official career site.

Where is the Senior Software Engineer, AI Infrastructure job at Microsoft located?

This Senior Software Engineer, AI Infrastructure position at Microsoft is located in Redmond, WA (On-site). Always check Microsoft's application page for specific state eligibility or relocation policies.

What qualifications are required for Senior Software Engineer, AI Infrastructure at Microsoft?

For the Senior Software Engineer, AI Infrastructure role, Microsoft highlights 4+ years of relevant experience; a bachelor's degree; experience with distributed systems, C#, Java, Go, software design, code review. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Senior Software Engineer, AI Infrastructure position at Microsoft?

This listing links directly to Microsoft's application page. You can apply directly on Microsoft's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.