Research Engineer, Audio and Speech
- Pay
- $200,000 – $400,000 per year
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Mid-level
- Experience
- 2+ years
- Listed
- 31 days ago
Skills & highlights for this role
- PyTorch
- speech ML
- low-latency inference
- signal processing
Also useful
- speech-to-speech models
- full-duplex models
- telephony
Stated benefits & perks
- Medical
- Dental
- Vision
- 401k
- Parental leave
About the Role
As a Research Engineer focused on Audio and Speech, you’ll be responsible for building the models and agent harnesses that power Decagon’s real-time voice agents and taking them all the way from idea to production. Your work will advance multimodal and full-duplex systems that can listen, reason, speak, and respond naturally in real time.
We’re looking for strong engineers who want to build the next generation of AI voice agents. People here own their work end-to-end, ship real improvements, and are trusted to make high-impact technical decisions.
In this role, you will
- Design and build next-generation agent harnesses optimized for streaming speech, turn-taking, interruptions, overlapping speech, and continuous interaction
- Research and train multimodal and full-duplex models that jointly understand audio, reason, and generate speech
- Improve speech recognition, voice activity detection, endpointing, and speech generation across diverse speakers, environments, domains, and languages
- Build evaluations and use production calls to ship measurable improvements in accuracy, latency, naturalness, and task outcomes
- Optimize end-to-end inference for responsiveness, throughput, stability, and cost, partnering with Voice Platform and Infrastructure teams to deploy at scale
Your background looks something like this
- 2+ years of experience in speech, audio ML, multimodal ML, or production machine learning
- Experience developing or adapting autoregressive, diffusion, flow-matching, or codec-based speech models
- Hands-on experience with streaming agent systems, low-latency inference, production model serving, and evaluation on real-world audio
- Fluency in Python and a modern deep-learning framework such as PyTorch, with strong foundations in machine learning and signal processing
- A track record of taking research ideas from prototype to reliable, measurable production impact
Even better if you have
- Familiarity with speech-to-speech or full-duplex models
- Experience with telephony, multilingual speech, noisy-channel robustness, speaker adaptation, or expressive speech generation
Compensation $200K - $400K + Offers Equity
Benefits
We proudly offer the following benefits for our full-time employees:
- Medical, Dental, and Vision benefits for you and your family
- Life Insurance and Disability Benefits
- Retirement Plan (e.g., 401K, pension)
- Parental Leave
- Fertility and family building benefits through Carrot
- Monthly stipend to support your wellness, lifestyle, and work-life balance
- Daily lunches and snacks in the office to keep you at your best
- Take what you need vacation policy (subject to local requirements; UK employees receive 25 days of statutory leave)
These benefits are described in more detail in Decagon’s policies, may vary by location, and can change at any time according to applicable compensation and benefits plans.
About Decagon
Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences.
Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel.
We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others.
We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values - Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle - shape how we work and grow as a team.
About the Team
Read more about the Speech Research Team's work
The Research team develops the model and decision-making stack that powers Decagon’s conversational agents for enterprise support. We research, adapt, and implement state-of-the-art techniques in model training, prompting, orchestration, and evaluation in order to make our agents more accurate, robust, and efficient in real-world deployments.
Our goal is to push the frontier of applied conversational AI: agents that reliably understand nuanced intent, track long context, and take the right actions under uncertainty. We measure success the way customers feel it: higher resolution rates, better user satisfaction, and consistent behavior at scale.
From Decagon's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Research Engineer, Audio and Speech role at Decagon, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
- Research EngineerDoji · New York City, NY
- Research EngineerMagic · San Francisco, CA
- Research Engineer, Applied AI EngineeringOuterSignal · New York City, NY
- Research Engineer, ML PlatformMistral · Palo Alto, CA
- Research Engineer, ML InfrastructureCognition · San Francisco, CA
- Research Engineer, Scientific Data & Workflow InfrastructureLila Sciences · San Francisco, CA
More at Decagon
All Decagon jobsCommon questions
What is the salary for the Research Engineer, Audio and Speech role at Decagon?
The Research Engineer, Audio and Speech posting at Decagon states compensation of $200,000 – $400,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Decagon's official career site.
Where is the Research Engineer, Audio and Speech job at Decagon located?
This Research Engineer, Audio and Speech position at Decagon is located in San Francisco, CA (On-site). Always check Decagon's application page for specific state eligibility or relocation policies.
What qualifications are required for Research Engineer, Audio and Speech at Decagon?
For the Research Engineer, Audio and Speech role, Decagon highlights 2+ years of relevant experience; experience with PyTorch, speech ML, low-latency inference, signal processing. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Research Engineer, Audio and Speech position at Decagon?
This listing links directly to Decagon's Ashby application page. You can apply directly on Decagon's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.