LiteLLM
AI & Machine LearningDirect Ashby career site

AI Engineer

Location
San Francisco, CA · On-site
Job type
Full-time
Level
Mid-level
Experience
1+ year
Listed
30 days ago

Skills & highlights for this role

  • Python
  • FastAPI
  • LLM APIs

Also useful

  • Redis
  • PostgreSQL
  • OpenAI API

Stated benefits & perks

  • Health
  • Dental
  • Vision

What You Will Be Working on

Skills: Python, LLM APIs, FastAPI

As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:

  • System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
  • Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
  • Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

Who We Are Looking for

  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and help solve real problems

About LiteLLM

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

Why Join LiteLLM?

  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.

About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Read the original posting

From LiteLLM's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this AI Engineer role at LiteLLM, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Start free with 5 tailored applications a monthChrome extensionFor AI assistantsPricingHow Rolev.ai comparesApplication guides

Similar roles

All Software Developer jobs

Common questions

Where is the AI Engineer job at LiteLLM located?

This AI Engineer position at LiteLLM is located in San Francisco, CA (On-site). Always check LiteLLM's application page for specific state eligibility or relocation policies.

What qualifications are required for AI Engineer at LiteLLM?

For the AI Engineer role, LiteLLM highlights 1+ year of relevant experience; experience with Python, FastAPI, LLM APIs. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the AI Engineer position at LiteLLM?

This listing links directly to LiteLLM's Ashby application page. You can apply directly on LiteLLM's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.

Tailor resume & applyCompany site