fal
AI & Machine LearningDirect Ashby career site

Software Engineer, Distributed Systems

Location
San Francisco, CA · On-site
Job type
Full-time
Level
Senior
Experience
3+ years
Listed
22 days ago

Skills & highlights for this role

  • Rust
  • Python
  • distributed systems
  • Linux systems

Also useful

  • JuiceFS
  • Lustre
  • DCGM
  • RDMA
  • InfiniBand
  • BGP
  • eBPF

About This Role

You are an experienced software engineer who is passionate about building large-scale computing platforms. You have experience building systems that remain reliable under high traffic, partial failures, and changing capacity. You know how to deliver reliability, performance, and scale with minimum operational load.

What You'll Do

  • Take ownership of one or more of the Rust/Python systems that power our AI inference and large-scale GPU computing platform
  • Design for 100x growth in workloads and GPU capacity, with reliable, low-latency execution across the globe
  • Use AI aggressively to accelerate development and automate repetitive operations, alerting, and recovery

You will specialize in one or more of these critical areas

  • Request routing and queuing on a global scale
  • App deployment and autoscaling
  • Worker orchestration and placement
  • GPU fleet autoscaling and capacity management
  • GPU fleet lifecycle automation: provisioning, diagnostics & recovery, upgrades, tracking
  • Global file storage, caching and distribution
  • Global IP backbone: private networking across datacenters, elastic public IPs, ACLs/firewalls, private connectivity
  • Workload execution: containerization, globally distributed filesystems, RAM/VRAM snapshotting

Qualifications/nice to Have

  • 3+ years building and operating large-scale production systems, with a track record of reliability and scale
  • Strong Rust and/or Python skills
  • Strong systems fundamentals, with technical depth relevant to your specialization: distributed coordination, scheduling, fault tolerance, Linux, networking, storage, or capacity management
  • Experience building and using observability to drive performance and reliability decisions
  • Clear communication, sound technical judgment, and the initiative to move quickly, drive decisions across teams, and own systems from design through production
  • Multi-tenant compute platforms, AI inference or training infrastructure, GPU workload scheduling
  • High-performance systems programming: async runtimes, zero-copy, memory-safe concurrency
  • Linux systems engineering and fleet automation: configuration management, kernel and driver debugging, safe upgrades, and automated recovery
  • Distributed filesystems like JuiceFS and Lustre
  • Experience with Nvidia/AMD GPU infrastructure; DCGM, NVLink, RDMA, InfiniBand/RoCEv2
  • Global networking and routing: BGP, ECMP, tunnels, eBPF, Geneve

What We Offer at fal

  • Interesting and challenging work
  • A lot of learning and growth opportunities
  • Regular team events and offsites

About fal

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

Read the original posting

From fal's careers page, first listed on Rolev.ai on October 17, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Software Engineer, Distributed Systems role at fal, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Software Engineer, Distributed Systems job at fal located?

This Software Engineer, Distributed Systems position at fal is located in San Francisco, CA (On-site). Always check fal's application page for specific state eligibility or relocation policies.

What qualifications are required for Software Engineer, Distributed Systems at fal?

For the Software Engineer, Distributed Systems role, fal highlights 3+ years of relevant experience; experience with Rust, Python, distributed systems, Linux systems. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Software Engineer, Distributed Systems position at fal?

This listing links directly to fal's Ashby application page. You can apply directly on fal's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.