Applied AI Engineer, Evals
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Mid-level
- Listed
- 23 days ago
Skills & highlights for this role
- statistics
- applied machine learning
- production codebase development
Also useful
- realtime voice AI
- browser automation
- computer-use agents
The Role
You translate what makes a good performance into clear, defensible signals, and use those signals to improve Aidan. Role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.
What You'll Do
- Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
- Build and maintain our internal benchmarks and simulations
- Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Who You Are
- Engineer with statistics and/or applied machine learning experience
- Comfortable in a production codebase
- Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.
About Sable
Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.
From Sable's careers page, first listed on Rolev.ai on October 17, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Applied AI Engineer, Evals role at Sable, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Applied AI Engineer, Evals job at Sable located?
This Applied AI Engineer, Evals position at Sable is located in San Francisco, CA (On-site). Always check Sable's application page for specific state eligibility or relocation policies.
What qualifications are required for Applied AI Engineer, Evals at Sable?
For the Applied AI Engineer, Evals role, Sable highlights experience with statistics, applied machine learning, production codebase development. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Applied AI Engineer, Evals position at Sable?
This listing links directly to Sable's Ashby application page. You can apply directly on Sable's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.