Senior and/or Principal Software Engineer- AI GPU Performance

About the role

As a Senior Software Engineer: Develop and optimize GPU kernels and runtime components for state-of-the-art LLM serving performance. Profile workloads and improve latency, throughput, and hardware efficiency. Integrate robust, maintainable optimizations into production serving systems. Collaborate across model, compiler, infrastructure, and hardware teams. Contribute to technical reviews, engineering standards, and mentoring.

Perform difficult, low-level optimization and resolve critical performance bottlenecks. Collaborate across research, infrastructure, and hardware teams to deliver measurable improvements. Bachelor's Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.

Expertise in GPU or equivalent accelerator programming and kernel optimization. Familiarity with vLLM, SGLang, or equivalent LLM inference libraries. Demonstrated cross-team collaboration and technical ownership. Ability to use AI-assisted development tools efficiently and validate their output. Deep expertise in GPU or equivalent accelerator compilation pipelines and low-level architecture.

Expertise in LLM training and inference parallelism and acceleration. Demonstrated ownership of cross-team technical initiatives from strategy through production. Track record of creating reusable platforms, influencing senior stakeholders, and mentoring technical leaders.