MTS, Post-Training (Enterprise)
- Pay
- $300,000 – $350,000 per year
- Location
- Mountain View, CA
- Job type
- Full-time
- Level
- Lead / Staff
- Listed
- 23 days ago
Skills & highlights for this role
- LLM post-training
- fine-tuning
- evaluation suite design
- regression testing
Also useful
- Llama
- Qwen
- Mistral
- DeepSeek
- LLM judges
- data flywheels
Stated benefits & perks
- Health
- Dental
- Vision
- 401k
About the Role
This is a delivery-heavy role focused on standing up our enterprise post-training capability. Demand is inbound, and our goal is to ship custom, high-performing models to 2-3 paying enterprise customers by year-end. Over the first 6-12 months, you will do the execution work required to solve real-world enterprise problems while helping build the scalable product underneath.
You will not be running abstract experiments or training models solely for benchmarks. You will sit directly at the intersection of enterprise demand and applied post-training-curating data, building rigorous eval suites, fine-tuning models, and proving their value to enterprise stakeholders. We will measure you on the production impact, robustness, and delivery of models shipped to real users, not on published papers.
The thing we care about most is whether you have done this before. If you have post-trained an LLM, shipped it to production users, managed regression risks, and owned the evals from end-to-end, we want to talk.
What You'll Do
- Ship enterprise-grade models. Post-train, fine-tune, and align open-weight and proprietary base models for complex business domains, ensuring they perform reliably in production.
- Build bespoke evaluation suites. Define what "quality" means for subjective domain-specific tasks, create custom benchmarks, and calibrate LLM judges against human domain experts.
- Curate and filter high-impact datasets. Build and run production data flywheels combining real production traces, human labeling, and synthetic augmentation with strict filtering standards.
- Manage and mitigate regression risk. Rigorously track downstream performance to ensure fine-tuning for new behaviors doesn't silently degrade core capabilities or reasoning.
- Engage directly with stakeholders. Sit in front of product and enterprise customers to understand their requirements, translate vague domain preferences into technical eval metrics, and explain model behavior clearly.
- Deploy for cost and privacy. Fine-tune open-weight architectures (e.g., Llama, Qwen, Mistral, DeepSeek) to hit strict enterprise latency, cost, and privacy targets.
- Direct frontier tools and workflows. Leverage state-of-the-art post-training techniques, preference tuning, and data curation tooling to maximize output quality and delivery speed.
What We're Looking For
- A record of shipped models. You have post-trained at least one LLM that was deployed to real users in production, and you can show how you measured its success.
- End-to-end eval ownership. Demonstrated experience building benchmarks, creating eval datasets, and getting stakeholders to agree on clear metrics for complex or subjective tasks.
- Deep understanding of regression risks. You can instinctively explain how training a model on new behaviors impacts existing capabilities and how to prevent it.
- Customer-facing or product empathy. Experience collaborating directly with non-ML stakeholders, enterprise customers, or product managers to turn requirements into model behavior.
- Strong software and ML fundamentals. Fluency in modern post-training frameworks, data processing pipelines, and code bases designed for production deployment.
- Ownership mindset. You take complete responsibility for the full post-training lifecycle-from raw data to model deployment and failure analysis-without requiring close supervision.
You May Be a Good Fit If You Also
- Have post-trained conversational or task-oriented assistants (e.g., support agents, multi-turn chat, tool-using agents)
- Have built LLM judges or reward models and calibrated them against human raters
- Have operated a production data flywheel: traces > labeling > synthetic augmentation > retrain
- Have extensive hands-on experience with open-weight models (Llama, Qwen, Mistral, DeepSeek) for cost, latency, or privacy optimization
- Come from forward-deployed engineer (FDE), founder, or early-stage startup backgrounds
What We Offer
- Location: Mountain View, CA (Preferred) or San Francisco, CA (Onsite); Remote considered
- Base Salary: $300,000 - $350,000 USD / year
- Additional Comp: 25% performance-based bonus + equity
Benefits & Perks
- Health, dental, and vision coverage
- 401(k)
- Daily onsite lunch provided
- Visa sponsorship and relocation support available
- Direct impact on how the industry trains and evaluates agents
We value different backgrounds and paths into this work. If this role excites you but you do not check every box, apply anyway.
About Bespoke Labs
Bespoke Labs is an applied AI research lab pioneering data and RL environment curation for training and evaluating agents.
Recently, we curated Open Thoughts, one of the best open reasoning datasets used by multiple frontier labs, trained SOTA specialized models such as Bespoke-MiniChart-7B and Bespoke-MiniCheck, and taught agents to do multi-turn tool-calling with reinforcement learning.
Bespoke is uniquely positioned to capture a large market share of data and RL environment curation.
From Bespoke Labs's careers page, first listed on Rolev.ai on October 17, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this MTS, Post-Training (Enterprise) role at Bespoke Labs, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Machine Learning Engineer jobs- Senior / Staff Machine Learning Engineer, ACAI Training & Inference PlatformApple · Cupertino
- Machine Learning Engineer 5 (Senior Manager, IC)Capital One · Chicago, IL
- Research, Tinker, RL SystemsThinking Machines Lab · San Francisco, CA
- Machine Learning Engineer, Answers RelevanceReddit · Remote -
- Senior ML Engineer, Core DevelopmentAnduril · Costa Mesa, CA
- Machine Learning Engineer (TS/SCI)Maxar · Herndon, VA
Common questions
What is the salary for the MTS, Post-Training (Enterprise) role at Bespoke Labs?
The MTS, Post-Training (Enterprise) posting at Bespoke Labs states compensation of $300,000 – $350,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Bespoke Labs's official career site.
Where is the MTS, Post-Training (Enterprise) job at Bespoke Labs located?
This MTS, Post-Training (Enterprise) position at Bespoke Labs is located in Mountain View, CA. Always check Bespoke Labs's application page for specific state eligibility or relocation policies.
What qualifications are required for MTS, Post-Training (Enterprise) at Bespoke Labs?
For the MTS, Post-Training (Enterprise) role, Bespoke Labs highlights experience with LLM post-training, fine-tuning, evaluation suite design, regression testing. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the MTS, Post-Training (Enterprise) position at Bespoke Labs?
This listing links directly to Bespoke Labs's Ashby application page. You can apply directly on Bespoke Labs's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.