AI Systems Performance Engineer

About the role

Please Note: 1. If you are a first time user, please create your candidate login account before you apply for a job. (Click Sign In > Create Account) 2. If you already have a Candidate Account, please Sign-In before you apply.

About the role

Senior AI Network Performance Engineer (NIC / Host Networking) We are seeking an experienced Senior AI Network Performance Engineer to join the Performance Lab within our Architecture group. You will benchmark AI inference, training, and storage workloads on GPU clusters, with a focus on NIC and host networking performance. Your reports will guide customers in deployment and help our marketing team position the product.

Your primary focus will be the server side of the network: the NIC, its drivers, and the host stack that connects AI workloads to the fabric. You will run rigorous benchmarks, isolate bottlenecks, and tune for maximum throughput and minimum latency. If you have gone deep on NIC performance, built or operated AI clusters, or run inference serving at scale, we want to hear from you.

Key Responsibilities

Benchmarking: Install, configure, and run AI performance benchmarks, including MLPerf (Training and Inference) and NCCL collective communication tests. NIC and host tuning: Optimize NIC, driver, and host network settings (RDMA/RoCEv2, congestion control, queue and interrupt configuration, NUMA placement) for distributed AI workloads.

• Debugging: Isolate performance bottlenecks across the Linux OS, server hardware, NICs, and the network.
• Automation: Build tools and frameworks that make benchmarking repeatable.
• Communication: Document test methodologies and present findings and recommendations to hardware, software, and networking teams.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• We typically look for 12+ years of related industry experience, but candidates with fewer years and an exceptional track record are encouraged to apply.
• Strong hands-on Linux experience, including system-level performance tuning and troubleshooting.
• Proficiency in Python or a similar scripting language.

• Deep experience in at least one of the following: NIC / host networking: performance tuning or validation of high-speed NICs, drivers, or RDMA/RoCEv2.
• AI cluster building: bringing up and tuning multi-node GPU clusters, including collective communication libraries such as NCCL.
• Proven ability to diagnose root causes of performance problems in distributed systems.

Pay and benefits

Experience in more than one of the three areas above. Experience with MLPerf Training or Inference. Familiarity with Ethernet switch and fabric behavior (PFC, ECN, load balancing). Experience with Docker, Kubernetes, or Slurm in AI deployments. Experience building CI/CD pipelines for performance regression testing. Must have authorization to work in the US.

Compensation and Benefits The annual base salary range for this position is USD 143,800.00 To USD 230,000.00 As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth. All subject to relevant plan documents and award agreements.

Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.

If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.