Institute of Foundation Models
AI & Machine LearningDirect Lever career site

Research Scientist, Agentic Data & Benchmarking

Location
Sunnyvale, CA · On-site
Job type
Full-time
Level
Mid-level
Listed
31 days ago

Skills & highlights for this role

  • agentic AI
  • benchmark design
  • dataset curation
  • reinforcement learning
  • tool-use data

Also useful

  • reinforcement learning environments
  • evaluation methodology

About the role

About the Institute of Foundation Models The Institute of Foundation Models (IFM) is a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you'll work at the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You'll help build groundbreaking AI systems with the potential to reshape entire industries, and contribute to establishing MBZUAI as a global hub for high-performance computing and deep learning.

About the role The Agents team trains advanced agentic language models that use reasoning and tool use to complete real tasks on a computer. This is a specialist role at the center of the loop that drives those models: the data we train on and the benchmarks we measure against.

You'll own the agentic data pipeline end-to-end - sourcing and generating high-quality trajectories, tool-use data, and RL environments - and the evaluation suite that tells us, rigorously and reproducibly, what our agents can actually do. These two halves are inseparable: benchmarks expose where models fail, and targeted data closes the gap.

The agents are only as good as the data they learn from and the evals that keep us honest, and this role owns both. This is a research scientist position for someone who wants depth in data and measurement rather than breadth across the whole stack.

You should be the kind of person who reads through datasets line by line, distrusts a metric until it's been validated, and gets satisfaction from making an eval suite that nobody questions.

Read the original posting

From Institute of Foundation Models's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Research Scientist, Agentic Data & Benchmarking role at Institute of Foundation Models, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Research Scientist, Agentic Data & Benchmarking job at Institute of Foundation Models located?

This Research Scientist, Agentic Data & Benchmarking position at Institute of Foundation Models is located in Sunnyvale, CA (On-site). Always check Institute of Foundation Models's application page for specific state eligibility or relocation policies.

What qualifications are required for Research Scientist, Agentic Data & Benchmarking at Institute of Foundation Models?

For the Research Scientist, Agentic Data & Benchmarking role, Institute of Foundation Models highlights experience with agentic AI, benchmark design, dataset curation, reinforcement learning, tool-use data. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Research Scientist, Agentic Data & Benchmarking position at Institute of Foundation Models?

This listing links directly to Institute of Foundation Models's Lever application page. You can apply directly on Institute of Foundation Models's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Lever application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.