Otter.ai
AI & Machine LearningDirect Greenhouse career site

Senior Software Engineer, AI Agent & LLM

Pay
$185,000 – $230,000 per year
Location
Mountain View, CA · Hybrid
Job type
Full-time
Level
Senior
Experience
5+ years
Listed
Today

Skills & highlights for this role

  • LLM application development
  • AI agent orchestration
  • backend distributed systems

Also useful

  • evaluation datasets and automated graders
  • production tracing and observability
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this Otter.ai role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

The Opportunity

We are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter's conversational knowledge engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale.

This is a hands-on role for someone who can move from an ambiguous product problem to a working production solution, define how quality should be measured, and drive improvements across services, models, and user experience.

Your Impact

  • Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks.
  • Advance Otter's conversational knowledge engine through better knowledge extraction, annotation, and indexing.
  • Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality.
  • Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
  • Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
  • Improve task completion, correctness, groundedness, reliability, latency, and cost.
  • Turn production traces, customer feedback, and usage signals into measurable product and model improvements.
  • Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities.

We're looking for someone who

  • Has 5+ years of AI Agent engineering, machine learning engineering, or related experience.
  • Brings strong backend or distributed-systems engineering skills.
  • Has hands-on experience building and shipping AI-agent or LLM-powered products.
  • Has a strong focus on AI quality and experience evaluating nondeterministic systems.
  • Can use data, traces, logs, and qualitative examples to identify and resolve complex failures.
  • Works effectively across services, technical domains, and organizational boundaries.
  • Combines strong product judgment with rigorous engineering and evaluation practices.
  • Operates with high agency, strong ownership, and a bias toward action.
  • Can take ambiguous problems from initial exploration through production launch and continuous improvement.
  • Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus.

Accessibility & Accommodations

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary Range

$185,000 to $230,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.

#LI-Hybrid

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Read the original posting

From Otter.ai's careers page, first listed on Rolev.ai on November 19, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Senior Software Engineer, AI Agent & LLM role at Otter.ai, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

What is the salary for the Senior Software Engineer, AI Agent & LLM role at Otter.ai?

The Senior Software Engineer, AI Agent & LLM posting at Otter.ai states compensation of $185,000 – $230,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Otter.ai's official career site.

Where is the Senior Software Engineer, AI Agent & LLM job at Otter.ai located?

This Senior Software Engineer, AI Agent & LLM position at Otter.ai is located in Mountain View, CA (Hybrid). Always check Otter.ai's application page for specific state eligibility or relocation policies.

What qualifications are required for Senior Software Engineer, AI Agent & LLM at Otter.ai?

For the Senior Software Engineer, AI Agent & LLM role, Otter.ai highlights 5+ years of relevant experience; experience with LLM application development, AI agent orchestration, backend distributed systems. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Senior Software Engineer, AI Agent & LLM position at Otter.ai?

This listing links directly to Otter.ai's Greenhouse application page. You can apply directly on Otter.ai's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Greenhouse application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.