Research Scientist
- Location
- Remote (US)
- Job type
- Full-time
- Level
- Senior
- Listed
- 31 days ago
Skills & highlights for this role
- LLM evaluation
- dataset quality metrics
- experiment design
Also useful
- reinforcement learning
- annotation tooling
The Role
As a Research Scientist focused on data, you’ll work at the cutting edge of LLM development by designing the datasets that shape how frontier models behave. You’ll partner directly with AI research teams to experiment with new data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and model performance.
This is a research-driven, impact-heavy role: you’ll have the opportunity to test ideas quickly in live production environments, shape data-centric methodologies for some of the world’s top AI labs, and help define how high-quality data fuels the next generation of AI systems.
What We’re Looking for
- Deep Curiosity About Data - Obsession with understanding how the structure, quality, and selection of data influence LLM performance
- Bias Toward Insight and Iteration - You think critically but move fast, designing lightweight experiments to generate actionable results
- Desire to Shape AI Development - Drive to build the foundational data layer that defines how the next generation of AI systems behave
What You'll Do
- Research data collection strategies and designing high-impact data slices that uncover model failure modes
- Model annotator behavior and designing experiments to optimize instruction clarity and reward signal reliability
- Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment
About US
Our mission is to raise AGI with the richness of human intelligence - curious, witty, imaginative, and full of unexpected brilliance.
Surge was founded by engineers and researchers who dreamed of building the next generation AI. We're building a platform that powers the most powerful models in the world in partnership with companies like Anthropic, Google, Microsoft, and Meta.
At Surge, we believe the path to AGI isn't just about scaling compute-it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.
From Surge AI's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Research Scientist role at Surge AI, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Data Scientist jobs- Master's University Grad Data Scientist (USA)Pinterest · San Francisco, CA · $125k – $168k/yr
- Data ScientistFmr · Boston, MA · $83k – $158k/yr
- Data Scientist / Sr Analyst (0030)OCT Consulting, LLC · McLean, VA · $100k – $120k/yr
- Part-Time Data ScientistHarvard University · Boston, MA · $57/hr
- Data ScientistGRVTY · Fort Meade, MD
- Data Scientist (Open Level)Formation Bio · Boston, MA
Common questions
Where is the Research Scientist job at Surge AI located?
Yes, this Research Scientist opening at Surge AI is listed as Remote (US). Always check Surge AI's application page for specific state eligibility or relocation policies.
What qualifications are required for Research Scientist at Surge AI?
For the Research Scientist role, Surge AI highlights experience with LLM evaluation, dataset quality metrics, experiment design. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Research Scientist position at Surge AI?
This listing links directly to Surge AI's Ashby application page. You can apply directly on Surge AI's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.