Lead Engineer, Applied AI (Customer Agent)
- Location
- Boston, MA · On-site
- Job type
- Full-time
- Level
- Director
- Listed
- Today
Skills & highlights for this role
- production agentic systems
- orchestration
- evaluation
- guardrails
- failure handling for non-deterministic systems
- technical direction and architecture
- hands-on software engineering
- cross-functional communication
Also useful
- multi-tenant agent platform at scale
- 0-to-1 product development
- startup experience
- production evaluation systems
- AI observability
- human-in-the-loop workflows
About the Role
As Lead Engineer, you'll set the technical and product direction for a core area of Customer Agent end to end, building a 0-to-1 agentic product with the speed and ownership of a startup, backed by the scale and resources of one of the most innovative tech companies on the East Coast, while staying hands-on with the hardest problems yourself.
This is a lead role, with a wide footprint across our agentic product - from orchestration to governance - that grows based on where the product is when you join. We're looking for an engineer who owns complex, ambiguous problems, who has built, scaled, and supported a production agentic system through everything that comes after the demo, and who up-levels the people, process, and technology around them.
How You'll Make an Impact
- Set the technical and product direction for a core area of Customer Agent, from architecture through production, and contribute to the direction of the platform overall.
- Take on the hardest technical problems in your area: orchestration, evaluation, guardrails, memory & context, failure handling for non-deterministic systems.
- Write and ship code, review designs, and make the hard calls in your area when there’s no obvious right answer.
- Define patterns that other engineers adopt, and mentor through design reviews rather than direct management.
- Partner with product, design, data science, and go-to-market leaders to shape what gets built, not just how it’s built.
- Evaluate emerging AI technologies and bring the ones worth betting on into production.
What We're Looking for
- You've built, scaled, and supported production agentic systems, not just prototyped them: real orchestration, evals, guardrails, and non-deterministic failure handling. You've owned your part of one through launch, incidents, and the operational reality after the demo.
- You've learned the hard lessons that only come from running agents in production: securing them against misuse and abuse, and the operational scar tissue of keeping a non-deterministic system reliable as usage grows.
- You've owned technical and product direction for a significant area before, not just your own component, and you can point to something you designed and championed that shipped and that other engineers built on.
- You're hands-on: writing code, reviewing your own and others’ architecture decisions, and debugging production issues yourself, not delegating the hardest problems away.
- Your patterns and designs are reused by other engineers, and you've unblocked many others’ projects, not just your own.
- You communicate complex technical trade-offs clearly across engineering and product audiences, and you can turn an undefined problem into a plan others rally behind.
Nice to Haves
- Experience working on a multi-tenant agent platform at production scale, where external customers configure their own agent behavior on shared infrastructure.
- Experience building 0-to-1 products or working in startup environments.
- A track record with production evaluation systems, AI observability, or human-in-the-loop workflows for LLM-powered products.
Boston, MA - In-Office Role
About the Team
Our Engineering team builds the AI systems that power how brands run their businesses on Klaviyo. We move fast, ship in production, and hold a high bar for what "AI-native" actually means: systems that make real judgment calls, not demos.
The Customer Agent team is one of the newest and most ambitious groups in that org, based in Boston and working in-office: we're building a conversational AI system that lets brands serve their own customers at a scale no human support team could match. We're still small enough that one engineer’s work visibly shapes how the whole platform evolves. We're past the demo stage: the team ships changes against live customer traffic, measures quality with real evaluation frameworks, and treats reliability as a product feature, not an afterthought.
From Klaviyo's careers page, first listed on Rolev.ai on November 12, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Lead Engineer, Applied AI (Customer Agent) role at Klaviyo, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Common questions
Where is the Lead Engineer, Applied AI (Customer Agent) job at Klaviyo located?
This Lead Engineer, Applied AI (Customer Agent) position at Klaviyo is located in Boston, MA (On-site). Always check Klaviyo's application page for specific state eligibility or relocation policies.
What qualifications are required for Lead Engineer, Applied AI (Customer Agent) at Klaviyo?
For the Lead Engineer, Applied AI (Customer Agent) role, Klaviyo highlights experience with production agentic systems, orchestration, evaluation, guardrails, failure handling for non-deterministic systems, technical direction and architecture. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Lead Engineer, Applied AI (Customer Agent) position at Klaviyo?
This listing links directly to Klaviyo's Ashby application page. You can apply directly on Klaviyo's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.