Member of Technical Staff, Coding Agents

The Role

We are hiring a Member of Technical Staff to help define how frontier coding agents are benchmarked and improved. This is a broad, high-ownership role for researchers who build.

You will partner with the world’s top AI researchers and thousands of software engineers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques, centered around applications of AI for Coding. You will work on questions at the center of frontier AI progress: what should be measured, how to design evaluations that reflect real capability, how to create high-signal feedback, and how to build the environments and data systems that make those answers actionable.

Early members of the team will have unusual influence over our technical direction, operating culture, and the open-source software, benchmarks, and research products we build. We care more about demonstrated research capability, technical judgment, and a builder's mindset than a specific title, degree, or career path.

Location: San Francisco preferred; we are open to exceptional candidates in other locations.

What You'll Do

• Create/publish Coding benchmarks that challenge state-of-the-art frontier agents.
• Understand/shape the frontier of coding agents and where the space is headed, publishing studies of interesting/impactful findings.
• Help the world’s top AI Labs improve their models for coding.
• Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.

What We're Looking for

• You’re extremely passionate about building software with agents, and regularly tinkering with the latest coding agents.
• Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
• At least one of the following:
• Previous experience working on a Coding benchmark.
• Published research on AI for Software / Code-Generation at NeurIPS, ICLR, ICML, COLM, etc.
• Extensive software engineering experience or strong GitHub profile of OSS contributions, along with deep knowledge of agent harnesses.

Perks

• Handshake delivers benefits that help you feel supported-and thrive at work and in life.
• The below benefits are for full-time US employees.
• Ownership: Equity in a fast-growing company
• Financial Wellness: 401(k) match, competitive compensation, financial coaching

Benefits

Family Support: Paid parental leave, fertility benefits, parental coaching:

Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend

• Growth: $2,000 learning stipend, ongoing development
• Office: Commuting support, free lunch, and gym in our SF office
• Time Off: Flexible PTO, 15 holidays + 2 flex days
• Connection: Team outings & referral bonuses