Member of Technical Staff - Distributed Systems
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Mid-level
- Education
- Bachelor's degree
- Listed
- 30 days ago
Skills & highlights for this role
- distributed systems
- scheduling
- RPC
- asynchronous messaging
- Kubernetes
Also useful
- Go
- C++
- Python
About the role
As a Member of Technical Staff, you will build the systems that schedule, route, and coordinate AI workloads across Gimlet’s infrastructure.
Different stages of an inference pipeline may run on different hardware, scale independently, and exchange state across the system. Your work will determine how those workloads are placed, coordinated, routed, recovered, and operated in production.
You will work across scheduling, orchestration, control planes, APIs, and fault tolerance. You will design systems that make distributed infrastructure easier to operate, enable workloads to run reliably across a heterogeneous fleet, and partner with compiler, ML systems, networking, and infrastructure engineers to connect the full execution stack.
What success looks like
In the first 12-18 months, you will
- Build scheduling and orchestration systems for heterogeneous compute
- Design systems that manage independently scalable stages of distributed inference pipelines
- Improve the reliability and fault tolerance of production AI infrastructure
- Develop control planes and APIs that simplify how workloads are deployed and managed
- Improve resource management and scheduling as Gimlet expands across new accelerator types, nodes, and data centers
- Help the platform scale across additional hardware, nodes, and data centers
You may be a good fit if you have
- Experience building or operating distributed systems in production
- Strong software-engineering and systems fundamentals
- The ability to reason about concurrency, consistency, failure modes, and system tradeoffs
- Experience with scheduling, resource management, RPC, or asynchronous messaging
- A bachelor’s degree in a relevant field or equivalent practical experience
Strong candidates may also have
- Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage
- Experience designing service-oriented architectures using RPC or asynchronous messaging
- Familiarity with scheduling, queues, or resource management systems
- Experience building reliable APIs and operating systems under high load
- Software development experience in languages commonly used for systems development (e.g., Go, C++, Python)
About us
Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.
We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.
We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.
Why join now?
Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.
- Solve hard problems.
- Own meaningful work.
- Build for production.
- Help define what’s next.
Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.
From Gimlet Labs's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Member of Technical Staff - Distributed Systems role at Gimlet Labs, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Member of Technical Staff - Distributed Systems job at Gimlet Labs located?
This Member of Technical Staff - Distributed Systems position at Gimlet Labs is located in San Francisco, CA (On-site). Always check Gimlet Labs's application page for specific state eligibility or relocation policies.
What qualifications are required for Member of Technical Staff - Distributed Systems at Gimlet Labs?
For the Member of Technical Staff - Distributed Systems role, Gimlet Labs highlights a bachelor's degree; experience with distributed systems, scheduling, RPC, asynchronous messaging, Kubernetes. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Member of Technical Staff - Distributed Systems position at Gimlet Labs?
This listing links directly to Gimlet Labs's Ashby application page. You can apply directly on Gimlet Labs's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.