Senior Systems Engineer, Amazon Special Projects

About the role

Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company's Think Big leadership principle to the highest levels. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. We launched products such as Comprehend Medical, Echo Frames and Amazon Explore. If you're interested in innovating at scale to address big challenges in the world, this is the team for you.

As the Sr. Systems Engineer, you will own the agent daemon that runs on compute nodes, the runtime sandbox that isolates workloads, and the local storage and caching layer that determines which assets are resident and ready to serve. You will build the detection logic that manages node availability, and the GPU capability reporting that tells the scheduler exactly what each node can handle. Your work directly determines whether the platform can deliver low-latency ML inference - and whether it can do so reliably at scale.

Key job responsibilities

• Design and implement the agent daemon on Linux, including GPU discovery, availability detection, and sandboxed container execution for ML inference workloads.
• Architect the local caching system - eviction policies, versioned manifests, disk budget management, and efficient update mechanisms that minimize data transfer for large model files.
• Build VRAM management and graceful workload migration logic.
• Integrate hardware attestation with the security engineer and support diverse hardware configurations and fleet onboarding automation.

Basic Qualifications

• 6+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience
• 6+ years of non-internship professional software development experience
• 6+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production
• 6+ years of systems design, software development, operations, automation, and process improvement experience
• 7+ years of experience in systems programming (Rust, Go, or C++)
• Deep knowledge of Linux internals, including process scheduling, memory management, and storage subsystems
• Hands-on experience with container runtimes (Docker, containers, or custom sandboxes)
• Experience with GPU tooling and management (nvidia-smi, NVML, CUDA runtime)
• Demonstrated ability to build software that runs reliably on heterogeneous hardware

Preferred Qualifications

• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
• Experience designing caching systems with constrained storage budgets (LRU, ARC, or custom policies)
• Background in edge computing, fleet management, or embedded systems engineering
• Familiarity with hardware attestation (TPM, TEE) from the device side
• Experience with storage performance profiling and optimization across hardware types
• Track record of building daemon/agent software that operates unattended for extended periods

Additional information

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Pay and benefits

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually