Principal Distributed Systems Software Engineer - Collectives
- Location
- San Jose, CA
- Posted
- 24 days ago
How well does your resume fit this job?
Upload your resume to see your score for this Advanced Micro Devices (AMD) role, what matches, what's missing, and your best other matches.
Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.
About the role
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.
Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.
The Role
As a core member of the Collectives and Network Performance team, you will play a pivotal role in defining and delivering industry-leading AI pre-training and distributed inference performance on AMD GPUs. Your expertise will be critical in optimizing collective communication libraries, scale-up and scale-out networking software, and training/inference performance across multi-GPU and multi-node systems.
You will engage with internal hardware, GPU library, compiler, runtime and ROCm teams as well as open-source maintainers to ensure seamless integration of optimizations, applying advanced engineering principles to drive continuous improvement across multiple generations of AMD GPUs and a wide range of state-of-the-art AI models.
The Person
Seeking an industry-leading expert in collective communication and network performance, with advanced technical and analytical skills in Linux environments and deep C++ expertise. The ideal candidate will excel in providing technical leadership, guiding teams, and driving projects and initiatives independently. You will define goals, scope, and own development efforts while collaborating effectively within a high-performing team.
You have deep knowledge of network, NIC and GPU hardware architecture, hands-on experience mapping model architectures to low-level software and hardware, and a strong grasp of current trends in distributed training and inference at scale.
Key Responsibilities
Drive Collectives & Network Strategy
Define goals, scope and roadmap for a major area of AMD’s collectives and network optimizations, and align them with hardware, framework and ROCm roadmaps.
Architect Collective Communication Libraries
Lead the design and development of collective algorithms and optimizations (e.g., all-reduce, all-to-all, all-gather) across scale-up and scale-out networks.
Optimize Distributed Training & Inference
Lead performance tuning, profiling and analysis of large-scale LLM, diffusion, multimodal, RecSys and generative AI models on single-node and multi-node systems, and drive the tradeoffs and design decisions.
Hardware-Software Co-Design
Participate in co-design of future scale-up networks, NICs and scale-out networks, and represent software performance requirements to hardware teams.
Performance Modeling & Tooling
Drive frameworks, tools and infrastructure for performance estimation, modeling, regression tracking and reporting.
Collaborate with Framework & Library Teams
Work closely with internal GPU library, compiler and runtime teams, and with open-source maintainers (e.g., PyTorch, JAX, vLLM, SGLang), to ensure optimizations are aligned with requirements and integrated upstream.
Customer & Partner Guidance
Provide guidelines on efficient network load balancing, workload scheduling and model sharding strategies.
Communicate with Leadership
Present performance analysis and modeling results to stakeholders and senior leadership, with concrete recommendations.
Software Engineering Best Practices
Apply sound engineering principles and set standards to ensure robust, maintainable solutions.
Lead, Guide & Mentor
Provide strategic direction and mentorship to junior team members, fostering growth and collaboration through code reviews, knowledge sharing and technical guidance.
Preferred Experience
Collective Communication & Network Expertise
Deep expertise in designing and optimizing collective communication libraries (e.g., RCCL, NCCL, MPI) and a thorough understanding of NIC, RDMA, scale-up and scale-out network architectures and their impact on model performance.
Performance Analysis & Modeling
Strong technical expertise and proven experience in performance analysis, projection and bottleneck identification across the full stack, from model to hardware.
Deep Learning Integration
Proven ability to integrate optimized communication into ML frameworks such as PyTorch, JAX, vLLM and SGLang, with a focus on throughput, scalability and efficient execution for training and inference.
Software Engineering Excellence
Advanced proficiency in C++ and Python with deep experience in performance tuning, debugging and robust test design, ensuring reliable, maintainable, high-performance codebases.
High-Performance Computing
Broad and in-depth experience with large-scale, heterogeneous compute environments; adept at optimizing AI workloads for performance, efficiency and resource utilization across clusters.
Technical Leadership & Communication
Demonstrated ability to lead initiatives across teams, mentor and coach engineers, and communicate effectively in writing and presentations, both internally and externally.
Professional experience
Senior level of industry experience in technical software development, with a focus on performance engineering, communication libraries, networking, and GPU/distributed systems.
Academic Credentials
- Master’s and/or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
- LOCATION: San Jose, CA or Austin, TX. Onsite.
- This role is not eligible for visa sponsorship.
- #LI-MV1
Benefits offered are described
AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
- AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
- This posting is for an existing vacancy.
Equal opportunity and legal notices
AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.
From Advanced Micro Devices (AMD)'s careers page, posted on October 28, 2026, first listed on Rolev.ai on November 22, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Principal Distributed Systems Software Engineer - Collectives role at Advanced Micro Devices (AMD), it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Common questions
Where is the Principal Distributed Systems Software Engineer - Collectives job at Advanced Micro Devices (AMD) located?
This Principal Distributed Systems Software Engineer - Collectives position at Advanced Micro Devices (AMD) is located in San Jose, CA. Always check Advanced Micro Devices (AMD)'s application page for specific state eligibility or relocation policies.
How do I apply for the Principal Distributed Systems Software Engineer - Collectives position at Advanced Micro Devices (AMD)?
This listing links directly to Advanced Micro Devices (AMD)'s application page. You can apply directly on Advanced Micro Devices (AMD)'s site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.