Inference Inc.
AI & Machine LearningDirect Ashby career site

Machine Learning Researcher

Pay
$250,000 – $350,000 per year
Location
San Francisco, CA · On-site
Job type
Full-time
Level
Mid-level
Experience
3+ years
Listed
Today

Skills & highlights for this role

  • PyTorch
  • transformer architectures
  • SFT
  • RLHF
  • DPO

Also useful

  • Hugging Face Transformers
  • DeepSpeed
  • Megatron
  • TRL
  • NVIDIA GPUs

Stated benefits & perks

  • Vision
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this Inference Inc. role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

About the role

Help us push the boundaries of what's possible in LLM post-training. If you love training models, exploring new architectures, running experiments, and turning research insights into products that ship, we'd love to meet you.

About the Role

You will be responsible for conducting research into experimental models, training systems, and modalities to create novel products for our customers. Your work will span from exploring new architectures and learning methods to optimizing latency and efficiency, with the goal of delivering better models to customers.

Your north star is pushing the frontier of what's possible in LLM post-training. You'll explore new techniques, run rigorous experiments, and when something works, help bring it into production with the help of your teammates. This includes training models for customers and running evaluations as part of validating your research. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to explore ambitious ideas and ship the ones that work.

Key Responsibilities

  • Research and experiment with new model architectures to improve quality, efficiency, or capability
  • Explore methods to decrease inference latency and improve serving efficiency
  • Run experiments with new learning methods, including novel approaches to SFT, RLHF, DPO, and other post-training techniques
  • Perform reinforcement learning research to improve model alignment and capability
  • Develop and improve our distillation pipeline for training high-quality models from frontier teachers
  • Train models for clients and run evaluations to validate research findings in production settings
  • Create robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance
  • Stay current with ML research and identify techniques that can improve our platform
  • Collaborate with applied engineers to bring successful research into production systems
  • Document findings and share knowledge with the team

Requirements

  • 3+ years of experience training AI models using PyTorch
  • Deep understanding of transformer architectures, attention mechanisms, and model internals
  • Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or other alignment techniques
  • Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Megatron, TRL, or similar)
  • Strong experimental methodology, including ability to design, run, and analyze rigorous experiments
  • Track record of implementing ideas from recent ML papers
  • Experience training on NVIDIA GPUs at scale
  • Strong foundation in ML fundamentals: optimization, loss functions, regularization, generalization

Nice-to-Have

  • Publications in ML venues
  • Experience with model distillation or knowledge transfer
  • Experience with LLM speed optimization techniques
  • Familiarity with vision encoders, multimodal models, or other modalities
  • Experience with distributed training and infrastructure at scale
  • Contributions to open-source ML projects

You don't need to tick every box. Curiosity and the ability to learn quickly matter more.

Compensation

We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $250,000 - $350,000, plus equity and benefits, depending on experience.

About Inference.net

Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are smaller, faster, and up to 90% cheaper. Our platform handles everything end-to-end: distillation, training, evaluation, and planet-scale hosting.

We are a well-funded ten-person team of engineers who work in-person in downtown San Francisco on difficult, high-impact engineering problems. Everyone on the team has been writing code for over 10 years, and has founded and run their own software companies. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do. Most of us are in the office 4 days a week in SF; hybrid works for Bay Area candidates.

Read the original posting

From Inference Inc.'s careers page, first listed on Rolev.ai on November 19, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Machine Learning Researcher role at Inference Inc., it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

What is the salary for the Machine Learning Researcher role at Inference Inc.?

The Machine Learning Researcher posting at Inference Inc. states compensation of $250,000 – $350,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Inference Inc.'s official career site.

Where is the Machine Learning Researcher job at Inference Inc. located?

This Machine Learning Researcher position at Inference Inc. is located in San Francisco, CA (On-site). Always check Inference Inc.'s application page for specific state eligibility or relocation policies.

What qualifications are required for Machine Learning Researcher at Inference Inc.?

For the Machine Learning Researcher role, Inference Inc. highlights 3+ years of relevant experience; experience with PyTorch, transformer architectures, SFT, RLHF, DPO. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Machine Learning Researcher position at Inference Inc.?

This listing links directly to Inference Inc.'s Ashby application page. You can apply directly on Inference Inc.'s site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.