Senior and/or Principal Software Engineer - Performance
- Location
- United States · On-site
- Job type
- Full-time
- Level
- Lead / Staff
- Experience
- 4+ years
- Education
- Bachelor's degree
- Listed
- 29 days ago
Skills & highlights for this role
- end-to-end LLM performance analysis
- GPU profiling
- CUDA
- PyTorch
- C++
Also useful
- ROCm
- Triton
- ONNX Runtime
- TensorFlow
About the role
As an Engineer on the team the common tasks of the job would include, but not be limited to: Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems Communicate and collaborate with our partners both internal and external Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, HW neural net acceleration Experience in end-to-end performance analysis and optimization of state of the art LLMs, including proficiency using GPU profiling tools Experience in DNN/LLM inference and experience in one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
From Microsoft's careers page, first listed on Rolev.ai on October 11, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Senior and/or Principal Software Engineer - Performance role at Microsoft, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Senior and/or Principal Software Engineer - Performance job at Microsoft located?
This Senior and/or Principal Software Engineer - Performance position at Microsoft is located in United States (On-site). Always check Microsoft's application page for specific state eligibility or relocation policies.
What qualifications are required for Senior and/or Principal Software Engineer - Performance at Microsoft?
For the Senior and/or Principal Software Engineer - Performance role, Microsoft highlights 4+ years of relevant experience; a bachelor's degree; experience with end-to-end LLM performance analysis, GPU profiling, CUDA, PyTorch, C++. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Senior and/or Principal Software Engineer - Performance position at Microsoft?
This listing links directly to Microsoft's application page. You can apply directly on Microsoft's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.