Freshworks
AI & Machine LearningDirect SmartRecruiters career site

Staff Backend AI Platform Engineer

Pay
$225,000 – $278,000 per year
Location
San Mateo, CA · Hybrid
Job type
Full-time
Level
Lead / Staff
Experience
6+ years
Listed
Yesterday

Skills & highlights for this role

  • Java
  • Python
  • LangChain
  • Kubernetes
  • Kafka

Also useful

  • LangGraph
  • Temporal
  • Terraform
  • PostgreSQL

Stated benefits & perks

  • Health
  • Dental
  • Vision
  • Equity
  • Flexible pto
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this Freshworks role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

About the role

We are seeking a Backend AI Platform Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows.

You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation. You will own the development of high-performance APIs and orchestration runtimes, integrating frameworks like LangChain, LangGraph, and LangSmith. This role is highly hands-on and requires a technical leader who can navigate a fast-paced environment while maintaining high engineering standards.

Key Responsibilities

Platform Backend Development

  • Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation.
  • API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows.
  • State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents.
  • Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems.

System Architecture & Execution

  • Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures.
  • Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow.
  • Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.

Integrations & Data Services

  • Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS).
  • Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability.

Security & Reliability

  • Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic.
  • Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility.
  • Mentorship: Provide technical guidance and code reviews for more junior backend engineers on the team.

Required Qualifications

  • 6+ years of backend engineering experience.
  • 1-2+ years of hands-on experience in AI/ML platform development.
  • Expert Proficiency: Strong programming skills in Java and Python.
  • Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases.
  • Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka.

Preferred Qualifications

  • Experience with AI-driven planning systems or dialog state tracking.
  • Background in enterprise security (RBAC, SSO, OAuth2).
  • Experience working in a high-growth SaaS or startup environment.
  • Active contributions to open-source backend or AI frameworks.

Additional Information

Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters.

The annual base salary range for this position is $225,000- $278,000. This role is also eligible for a target bonus.

Compensation is based on a variety of factors, including but not limited to location, experience, job-related skills, and level.

Freshworks offers multiple options for dental, medical, vision, disability, and life insurance. Equity + ESPP, flexible PTO, flexible spending, commuter benefits, and wellness benefits are also offered. Freshworks also offers adoption and parental leave benefits.

Fresh vision. Real impact. Come build it with us.

About the Company

Software should help a business move as one. But too often, disconnected systems, scattered data, and fragmented workflows get in the way.

Freshworks is building a better way: AI-powered, unified service operations that turn complexity into coordinated action. Our platform brings together people, AI, data, and workflows so IT and service teams can anticipate what matters, act faster, and keep the business moving forward together. Organizations including Bridgestone, McLaren, New Balance, S&P Global, and Sony Music trust Freshworks to power the services their employees and customers depend on every day.

We bring that same belief in coordinated action to how we work by giving people the ownership to make bold moves at speed, and a team that moves with them.

Read the original posting

From Freshworks's careers page, first listed on Rolev.ai on November 18, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Staff Backend AI Platform Engineer role at Freshworks, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

What is the salary for the Staff Backend AI Platform Engineer role at Freshworks?

The Staff Backend AI Platform Engineer posting at Freshworks states compensation of $225,000 – $278,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Freshworks's official career site.

Where is the Staff Backend AI Platform Engineer job at Freshworks located?

This Staff Backend AI Platform Engineer position at Freshworks is located in San Mateo, CA (Hybrid). Always check Freshworks's application page for specific state eligibility or relocation policies.

What qualifications are required for Staff Backend AI Platform Engineer at Freshworks?

For the Staff Backend AI Platform Engineer role, Freshworks highlights 6+ years of relevant experience; experience with Java, Python, LangChain, Kubernetes, Kafka. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the Staff Backend AI Platform Engineer position at Freshworks?

This listing links directly to Freshworks's SmartRecruiters application page. You can apply directly on Freshworks's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the SmartRecruiters application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.