Product Engineer
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Mid-level
- Education
- Bachelor's degree
- Listed
- 30 days ago
Skills & highlights for this role
- Python
- FastAPI
- API design
Also useful
- LLM infrastructure
- developer tools
Stated benefits & perks
- Health
- Dental
- Vision
About the Role
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
- Build new product features from concept to production.
- Work directly with customers to understand pain points and validate solutions.
- Ship quickly while maintaining a high quality bar.
- Prototype new ideas and iterate based on user feedback.
- Own major product areas and continuously improve them over time.
- Design backend APIs and services using Python and FastAPI.
- Build intuitive developer experiences across our API, dashboard, and CLI.
- Collaborate directly with the founders on product direction and technical decisions.
- Help define and build LiteLLM's second major product.
What We're Looking for
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong software engineering fundamentals.
- Experience building production software, preferably with Python.
- Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
- Strong product intuition and curiosity about how customers use software.
- Excellent written and verbal communication.
- High ownership-you naturally identify problems and solve them without waiting to be asked.
- Comfortable operating in ambiguity and making decisions with incomplete information.
- Excited by shipping quickly and learning from real users.
Bonus Points
- Experience at an early-stage startup.
- Experience building developer tools or infrastructure products.
- Open source contributions.
- You've built and launched your own product.
- Familiarity with AI infrastructure, LLMs, or developer platforms.
About LiteLLM
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
Why Join LiteLLM?
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
From LiteLLM's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Product Engineer role at LiteLLM, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Product Engineer job at LiteLLM located?
This Product Engineer position at LiteLLM is located in San Francisco, CA (On-site). Always check LiteLLM's application page for specific state eligibility or relocation policies.
What qualifications are required for Product Engineer at LiteLLM?
For the Product Engineer role, LiteLLM highlights a bachelor's degree; experience with Python, FastAPI, API design. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Product Engineer position at LiteLLM?
This listing links directly to LiteLLM's Ashby application page. You can apply directly on LiteLLM's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.