Software Development Engineer, Trainium Systems

About the role

Have you ever wondered what it takes to build the software systems that turn a rack of AI accelerators from inert silicon into a system a customer can run workloads on? Do you want deep ownership of a service that every one of those systems depends on to boot, run, and stay healthy?

Who are we?

Annapurna Labs is the part of Amazon that designs the custom silicon behind the cloud, including Trainium for AI training, Graviton CPUs, and the AWS Nitro system. Nearly every server in AWS runs hardware we designed. We build the chips, the systems, and the software that power some of the largest AI training and inference workloads in the world.

What do we do?

We build the software that provisions, operates, updates, and monitors the servers behind AWS's largest AI training workloads, built on Trainium, Graviton, and the AWS Nitro system. We give the people who run this hardware a complete way to stand it up, watch its health, deliver new software to it, and diagnose it, all through open, standard interfaces. We own that software from design through the running system.

Why it's high-impact?

The hardware is just silicon until our software makes it provisionable, observable, and serviceable. Every system runs through what we build. The service you own is on the path for all of them, and the people who run this hardware depend on it every day.

What's the challenge?

There are many ambiguous and difficult challenges in our fast-moving space. Our services require deep system and software expertise. You need to have the ability to work within a fast moving and startup-like environment in a large company. You will identify solutions, trying ideas, given space to fail and iterate to produce products that your customers love.

What you will do?

You own a service in the management plane, in provisioning, monitoring, telemetry, software delivery, or diagnostics, depending on where the team needs you. You take it from design to production, you work backward from what the operator needs, and you build on the interfaces the hardware teams expose.

Who would succeed in this role?

An engineer who likes building and operating a service in production and takes it the whole way. You read logs and reason across process and system boundaries, you ship in small verifiable steps, and you turn requirements into a service other people rely on.

Key job responsibilities

• Own the design and implementation of a large component or service in the management plane, in provisioning, monitoring, telemetry, software delivery, or diagnostics.
• Make the application-level trade-offs on your component, and seek direction on the calls that reach beyond it.
• Automate and simplify the team's development, test, and operations work, and mentor peers as you grow.
• work backward from customer requirements and deliver solutions that are simple.

A day in the life

• You design and build the provisioning and management surface over standard interfaces like Redfish, and the boot flow operator tools drive.
• You build the offline software-update service and prove the signed bundle applies and recovers cleanly.
• You design each system against the interfaces the platform exposes and turn architecture decisions into APIs and tools a customer runs without you in the loop.

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 3+ years of software development engineer or related occupational experience
• 3+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 2+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
• Experience programming with at least one software programming language

Preferred Qualifications

• 4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Experience building complex software systems that have been successfully delivered to customers
• Experience in debugging, profiling, and implementing software engineering best practices in large-scale systems
• Knowledge of computer architecture, operating systems, and parallel computing
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence

Additional information

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Pay and benefits

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

• USA, CA, Cupertino - 165,200.00 - 223,600.00 USD annually
• USA, CA, San Diego - 143,700.00 - 194,400.00 USD annually
• USA, TX, Austin - 143,700.00 - 194,400.00 USD annually
• USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually