Inference Engineer

About the Role

We're hiring an Inference Engineer to advance our mission of building real-time multimodal intelligence.

Your Impact

• Design and build low latency, scalable, and reliable model inference and serving stack for our cutting edge foundation models using Transformers, SSMs and hybrid models.
• Work closely with our research team and product engineers to serve our suite of products in a fast, cost-effective, and reliable manner.
• Design and build robust inference infrastructure and monitoring for our products.
• Have significant autonomy to shape our products and directly impact how cutting-edge AI is applied across various devices and applications.

What You Bring

Given the scale and difficulty of problems we work on, we value strong engineering skills at Cartesia.

• Strong engineering skills, comfortable navigating complex codebases and an eye for writing clean and maintainable code.
• Experience building large-scale distributed systems with high demands on performance, reliability, and observability.
• Technical leadership with the ability to execute and deliver zero-to-one results amidst ambiguity.
• Background in or experience working on inference pipelines with machine learning and generative models.
• Experience implementing state of the art Machine Learning models and research to applied problems.
• Preferable: experience with vLLM, SGLang, Continuous Batching or other inference frameworks.
• Preferable: experience working in CUDA, Triton or similar

More Details

In-office policy: We’re an in-person team based out of offices in San Francisco, London and Bangalore. We love being in the office, hanging out together, and learning from each other every day.

Visa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.

• We ship fast.
• All of our work is novel and cutting edge, and execution speed is paramount.
• We have a high bar, and we don’t sacrifice quality or design along the way.

We support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.

Our Benefits (Us Employees Only)

• Compensation Competitive base salary alongside attractive equity package.
• Health Insurance Fully covered medical insurance along with dental and vision for you and your family.
• Parental Leave 9 weeks paternity & 12 weeks maternity leave
• 401(k)
• Commuter Allowance A monthly stipend to help you get to and from the office.
• Flexible PTO Take as much time as you need to recharge your batteries.
• Meals & Snacks Lunch, dinner and plenty of snacks, provided daily.
• Your own personal Yoshi