Research Engineer
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Mid-level
- Listed
- 30 days ago
Skills & highlights for this role
- model evaluation
- benchmarking
- failure analysis
Also useful
- human-in-the-loop evaluation
- agent observability
- memory systems for LLM agents
Stated benefits & perks
- Health
- Dental
- Vision
- Equity
Some concrete research problems on our plate right now
- Proactivity: An agent embedded in a team's channels has to decide, message by message, whether to ignore, quietly track, or intervene. Evaluating that judgment means building benchmarks where the ground truth includes silence. Existing agent benchmarks are almost entirely reactive.
- Memory: What should a workspace agent remember across weeks and months of participation, in what representation, and how do you measure whether memory is helping versus hurting agent usefulness?
- Continual Learning: How much does basic memory, retrieval, and context impact agent performance, vs where do we genuinely need RL and continual learning?
What you’ll be doing at Ando
You'll be one of the first members of a small research team, working close to both the data and the product.
- Build evaluation from real data - Mine production workspace data (carefully, with consent and redaction pipelines you'll help design) into benchmarks and labeled datasets. Design label schemas, run labeling with real inter-rater rigor, and build the harnesses that make expert judgment cheap to capture and hard to corrupt.
- Run experiments that ship - Initial work happens on offline workspace data; the destination is production systems used by every Ando customer. The distance between "the benchmark improved" and "the feature shipped" should be weeks and you'll own both ends.
- Decide what we build versus who we partner with - We won't do everything in-house. Part of the job is evaluating frontier vendors and research teams (eval infrastructure, observability, continual-learning tooling) and choosing who we build with.
- Publish when we have something real - We expect the team to publish as we make meaningful progress. But ideas are not Ando's moat; execution, product quality, and customer experience are. Research here is in service of customers first, and the publications will be better for it: they'll describe things that actually worked on real data.
What We're Looking for
- Strong applied research background, with depth in model evaluation, benchmarking, and/or failure analysis. You've built evals you trusted enough to make decisions with.
- Evidence over credentials. Work samples or code that demonstrate the skills: eval frameworks, benchmark suites, failure-analysis reports or tooling, labeling infrastructure. Show us something you built to find out whether a system actually worked.
- Strong technical communication. You can explain complex ideas simply and hold high-bandwidth, generative technical conversations with researchers and with our product team.
- Comfort with mess. Real workspace data is incomplete, ambiguous, and full of edge cases that break clean abstractions. You treat that as signal, not noise.
- Bonus: familiarity with simulation (Park et al.), human-in-the-loop evaluation (Scale HIL leaderboard), Cartridges and related context/memory-compression work, memory for multi-party long-running settings, or agent observability standards (setting up Langsmith or similar).
Hiring process
- 30 min intro call
- Technical conversation - walk us through an app you've shipped
- Paid take-home or IRL work trial
Benefits
- Free Equinox membership & other health perks
- Generous equity grant vested over 4 years
- Health, dental, vision insurance
About Ando
Ando is a messaging platform where AI agents take on work alongside their human teammates. We’re rebuilding Slack from the ground up around two core ideas: durable memory and agents as first-class participants.
We have real, longitudinal, multi-party workspace data, and human / agent users whose behavior tells you whether the systems you're designing are actually meaningfully improving. Working with live business communication means permissions, redaction, and security are things we have to think about as well. If you want to have your research come into contact with reality, Ando is the place for it.
From Ando's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Research Engineer role at Ando, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Research Scientist jobs- CED Faculty ScholarLLNL · Livermore, CA
- Research Scientist, Infrastructure Modeling and ReliabilityMeta · Menlo Park, CA
- Senior Researcher - Security - Microsoft ResearchMicrosoft · United States · $120k – $235k/yr
- Lead Quantum Error Correction ResearcherRiverlane · Boston, MA
- Applied AI Researcher, BenchmarkingDistyl AI · San Francisco, CA
- Quantitative ResearcherPDT Partners · New York, NY
Common questions
Where is the Research Engineer job at Ando located?
This Research Engineer position at Ando is located in San Francisco, CA (On-site). Always check Ando's application page for specific state eligibility or relocation policies.
What qualifications are required for Research Engineer at Ando?
For the Research Engineer role, Ando highlights experience with model evaluation, benchmarking, failure analysis. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Research Engineer position at Ando?
This listing links directly to Ando's Ashby application page. You can apply directly on Ando's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.