Advanced Micro Devices (AMD)
Direct employer career site

Advanced AI Workloads - Performance and Scalability Engineer

Location
San Jose, CA
Posted
18 days ago
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this Advanced Micro Devices (AMD) role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

About the role

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.

The Role

AMD is looking for a performance-obsessed engineer to drive AI inference performance to the absolute limit on AMD GPUs. You will lead a small, highly technical team and work end-to-end across the stack: profiling, diagnosing, and optimizing leading models on customer-relevant serving configurations (e.g. agentic coding, long-context, high-throughput serving).

You move from challenge to challenge, tackling the hardest performance problems across our most strategic customer engagements and leaving behind measurable uplifts and reusable methodology. This is not a sustaining role: every engagement is different, every optimization leaves a lasting impact.

The Person

You can take any AI workload, understand it top to bottom, and make it faster. You are equally comfortable profiling a distributed serving deployment, diagnosing a kernel-level bottleneck, and presenting optimization results to a customer's VP of Engineering.

You understand GPU kernel performance deeply: not just how to use profiling tools, but how to reason about occupancy, cache behavior, memory coalescing, and instruction-level bottlenecks from first principles. You lead through technical depth: you set the standard for your team by doing the hardest work yourself and pulling others up along the way.

You are AI-fluent, not just in the models you optimize, but in how you work: you leverage AI agents and tools daily to accelerate your workflows, and you actively define new ways of using them to make yourself and your team more effective. You thrive under pressure, move fast, and measure everything.

Key Responsibilities

  • Drive performance optimization end-to-end across the stack on leading models and customer-relevant serving configurations, closing competitive gaps through kernel and systems-level optimizations
  • Profile, diagnose, and resolve the hardest cross-stack performance bottlenecks, from GPU kernels and operator dispatch to framework-level scheduling and multi-node communication
  • Diagnose kernel-level performance issues using profiling tools: identify occupancy limitations, L2 cache thrashing, register pressure, memory coalescing issues, etc, and translate findings into actionable optimizations
  • Lead customer-facing technical engagements: present findings, recommend optimizations, and deliver measurable performance uplifts
  • Integrate and optimize custom kernels (Triton, Gluon, CK, PyDSL, ASM, AITER) within serving frameworks, understanding dispatch paths, shape extraction, and backend selection
  • Optimize multi-node distributed inference: communication-compute overlap, parallelism strategies, and scale-out performance
  • Develop and refine shared performance optimization methodology that raises the bar across the broader team
  • Leverage AI agents to accelerate daily work and define best practices for AI-assisted performance engineering
  • Upstream optimizations into open-source frameworks such as vLLM, SGLang, and PyTorch

Preferred Experience

  • Software development experience in GPU computing, AI systems, or high-performance computing
  • Deep hands-on experience with AI serving frameworks (vLLM, SGLang, TensorRT-LLM, or similar) and their internals
  • Strong background in end-to-end workload profiling and bottleneck diagnosis: you can trace from user request to GPU kernel and back
  • Understanding of GPU kernel performance characteristics: occupancy, register and LDS pressure, memory coalescing, cache utilization, wavefront scheduling, and instruction-level bottlenecks
  • Ability to read and reason about kernel-level profiling data and translate it into concrete optimization actions. You may not write kernels from scratch daily, but you can tell exactly why one is slow and what needs to change
  • Understanding of model architectures (transformers, MoE, diffusion), inference paradigms (speculative decoding, prefill-decode disaggregation, continuous batching), and how they map to hardware
  • Experience with custom kernel development or integration (HIP, CUDA, Triton, CK, or similar)
  • Understanding of multi-GPU and multi-node distributed systems: scale-up and scale-out topologies, RCCL/NCCL, RDMA, and communication-compute overlap
  • System and rack-level design awareness: understanding performance tradeoffs across the full deployment stack
  • Strong proficiency in Python and C++
  • Customer-facing technical leadership experience: ability to engage with customers, present findings, and drive decisions
  • Fluent in AI-assisted development: daily user of AI agents and tools, with a mindset toward defining new AI-powered workflows
  • Strong Linux systems knowledge
  • Excellent written and verbal English communication skills

Preferred Academic Credentials

Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent. Advanced degree preferred but exceptional industry experience valued equally.

LOCATION: San Jose, CA, preferred

  • This role is not eligible for visa sponsorship.
  • #LI-DNI

Benefits offered are described

AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

  • AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
  • This posting is for an existing vacancy.
Read the original posting

From Advanced Micro Devices (AMD)'s careers page, posted on November 3, 2026, first listed on Rolev.ai on November 22, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Advanced AI Workloads - Performance and Scalability Engineer role at Advanced Micro Devices (AMD), it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Advanced AI Workloads - Performance and Scalability Engineer job at Advanced Micro Devices (AMD) located?

This Advanced AI Workloads - Performance and Scalability Engineer position at Advanced Micro Devices (AMD) is located in San Jose, CA. Always check Advanced Micro Devices (AMD)'s application page for specific state eligibility or relocation policies.

How do I apply for the Advanced AI Workloads - Performance and Scalability Engineer position at Advanced Micro Devices (AMD)?

This listing links directly to Advanced Micro Devices (AMD)'s application page. You can apply directly on Advanced Micro Devices (AMD)'s site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.