Litera
LegalDirect Workday career site

LLM Ops Engineer

Pay
$105,000 – $130,000 per year
Location
Denver, CO · Hybrid
Job type
Full-time
Level
Senior
Experience
3+ years
Listed
30 days ago

Skills & highlights for this role

  • LLM operations
  • OpenAI
  • Anthropic
  • Azure OpenAI
  • AWS Bedrock
  • Python
  • API gateway
  • load balancing

Also useful

  • Kubeflow
  • MLflow
  • Apache Airflow
  • Kubernetes
  • RAG
  • vector databases

Stated benefits & perks

  • Medical
  • Dental
  • Vision
  • 401k match

About the role

Ready to Help Shape the Future of Legal Tech?! At Litera, we don't just build software, we transform how the world's top law firms operate. Every day, we Raise The Bar™ for what's possible through AI, innovation, and solutions that power millions of legal professionals worldwide. If you're energized by scale, real impact, and meaningful challenges, you'll feel right at home here.

Where You'll Work This is a hybrid role based in Denver, CO with the expectations to be in office at least 3 days a week for collaboration and connection. Why this Role Matters At Litera, AI is becoming a critical enabler of how we build products, improve customer experiences, and drive innovation.

As an LLM Ops Engineer, you will create the secure, scalable, and reliable foundation that allows our engineering teams to leverage AI confidently and efficiently across the business. Your work will ensure that AI capabilities are available, governed, cost-effective, and ready to support production applications at scale.

This role is instrumental in accelerating AI adoption while maintaining the performance, security, and resilience required for enterprise software. What You'll Deliver Build and operate a scalable AI platform that enables engineering teams to seamlessly access and deploy models across multiple providers and environments.

Ensure high availability and resiliency of AI services through intelligent routing, failover strategies, and production-grade infrastructure. Establish secure and compliant AI operations by protecting model access, safeguarding sensitive data, and enforcing governance standards. Create a consistent developer experience through unified APIs, self-service capabilities, tooling, and best practices that accelerate AI adoption.

Optimize AI platform performance, reliability, and cost efficiency through proactive monitoring, analytics, and provider strategy management. Lead the evolution of Litera's AI operations capabilities by evaluating emerging technologies and recommending scalable solutions. Deliver observability and operational excellence through dashboards, alerting, quality monitoring, and service-level metrics.

Support the safe deployment of AI solutions by implementing testing frameworks, quality controls, and production readiness standards. We're committed to creating an inclusive environment. If you need accommodations at any point in the process or in the role, we're here to support you.

Pay and benefits

3+ years of experience in DevOps, Platform Engineering, MLOps, or a related field, including hands-on experience operating LLMs in production environments. Experience deploying, managing, and scaling models across multiple AI providers such as OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, or Google Vertex AI.

Strong expertise in building highly available, secure infrastructure, including load balancing, failover strategies, secrets management, and access controls. Experience with API management, gateway technologies, and production-grade AI service operations. Strong Python programming skills with experience developing and supporting scalable systems.

Proven ability to solve complex technical challenges and thrive in a fast-paced, evolving environment while collaborating across teams. Nice to Haves: Experience fine-tuning or training large language models for domain-specific applications. Familiarity with ML orchestration tools and frameworks such as Kubeflow, MLflow, or Apache Airflow.

Experience with LLM evaluation frameworks, retrieval-augmented generation (RAG), vector databases, or inference optimization techniques. Knowledge of infrastructure-as-code, Kubernetes, compliance frameworks, or large-scale AI cost optimization strategies. We know great candidates don't always check every box. If you're excited about this role, we encourage you to apply. What You'll Experience A team that shows up.

Work alongside people who collaborate, support one another, and lead with integrity. Global Reach. Partner with teams around the world to solve complex challenges that matter. Real opportunity for growth. Expand your impact through meaningful stretch opportunities, visibility and career development. AI-driven innovation. Work at the intersection of legal technology, customer outcomes, and cutting-edge AI.

Pay Transparency for Colorado Applicants The base salary range for this role is $105,000 to $130,000 USD. Final compensation will be determined based on experience, skills, education, and other relevant qualifications. This role is also eligible to participate in a company bonus plan.

In addition to base salary, Litera offers a comprehensive benefits package, including medical, dental, and vision coverage, a 401(k) with company match, and incentive and recognition programs. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Equal opportunity and legal notices

Benefits are subject to eligibility requirements. #LI-Hybrid Litera is an equal opportunity employer.

Read the original posting

From Litera's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this LLM Ops Engineer role at Litera, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Start free with 5 tailored applications a monthChrome extensionFor AI assistantsPricingHow Rolev.ai comparesHow Workday screens applications

Similar roles

All Software Developer jobs

Common questions

What is the salary for the LLM Ops Engineer role at Litera?

The LLM Ops Engineer posting at Litera states compensation of $105,000 – $130,000 per year. It is listed as a full-time position. Final pay may depend on location, experience, and interview evaluation on Litera's official career site.

Where is the LLM Ops Engineer job at Litera located?

This LLM Ops Engineer position at Litera is located in Denver, CO (Hybrid). Always check Litera's application page for specific state eligibility or relocation policies.

What qualifications are required for LLM Ops Engineer at Litera?

For the LLM Ops Engineer role, Litera highlights 3+ years of relevant experience; experience with LLM operations, OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Python. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the LLM Ops Engineer position at Litera?

This listing links directly to Litera's Workday application page. You can apply directly on Litera's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Workday application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.

Tailor resume & applyCompany site