Software Engineer 5, AI Observability
- Pay
- $500,000 – $860,000 per year
- Location
- Remote (US)
- Listed
- Today
How well does your resume fit this job?
Upload your resume to see your score for this Netflix role, what matches, what's missing, and your best other matches.
Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.
The Opportunity
The AI Observability team makes AI, ML, and Agentic systems transparent, reliable, and production-ready at scale. We build end-to-end observability for ML and GenAI workloads, capturing model inputs, features, predictions, outcomes, and behavior across online and batch systems. Our platform enables teams to monitor model performance, data quality, drift, latency, and failures, turning the ML system from a black box into an explainable, debuggable system. We provide developer-friendly libraries, dashboards, and alerts so teams can debug issues, respond to incidents, and ship AI-powered products with confidence.
We're looking for a hands-on senior engineer to build the frameworks behind Netflix's AI Observability platform, model performance, evaluation, and vendor integration surfaces. You will design reusable infrastructure that enables ML/AI practitioners across domains to monitor model quality in production, evaluate LLM and agentic systems, and adopt vendor tooling through a consistent, self-serve platform.
AIP owns the generic, reusable infrastructure; domain teams own their domain-specific evals and remediation. You will partner closely with engineering, product, machine learning, and data teams to turn their needs into reusable platform capabilities. To succeed, you will bring a strong background in AI or ML infrastructure and a passion for building scalable, robust systems.
In this role, you will
- Build the observability framework and platform capabilities that give ML and GenAI systems metrics, logs, and distributed traces across online inference, batch scoring, feature pipelines, and agent orchestration, so teams can instrument their systems consistently.
- Build the primitives that let teams monitor model performance (accuracy, calibration, error rates), data quality, drift, and degradation on their own systems, rather than monitoring individual models yourself.
- Build and extend evaluation frameworks for LLM and agentic systems that support response quality, grounding and hallucination, task success, tool-use and trajectory correctness, and LLM-as-a-judge and human-in-the-loop scoring, giving teams reusable building blocks to define and run their own evals.
- Lead build-vs-buy evaluations for observability and eval tooling, and own the SDKs, connectors, and APIs that integrate vendor platforms into a consistent, well-supported interface, so ML and product teams can onboard models and agents with minimal friction.
- Build reusable libraries, SDKs, and templates that make observability and evaluation the default for new systems ("observability-by-default"), lowering the barrier for teams to instrument and evaluate their work.
- Provide the dashboarding, alerting, and SLO/SLI building blocks (plus sensible out-of-the-box templates) that teams use to track model performance, latency, cost, and reliability.
To succeed in this role, you will need
- Experience in software, AI/ML, or platform engineering, with hands-on time in production observability, monitoring, or ML/LLM evaluation
- Proven track record of designing standards, libraries, SDKs, or frameworks that other teams build on and adopt, reflecting a platform and enablement mindset rather than shipping features for a single use case.
- Strong coding skills in Python and at least one of Java, Go, or Scala, with experience building production services
- Practical experience operating ML models in production (online serving and/or batch), including drift, model performance, and data quality.
- Hands-on experience with modern observability stacks (e.g., Prometheus/Grafana, Datadog, OpenTelemetry, ELK/OpenSearch, Jaeger/Tempo, or similar).
- Solid understanding of distributed systems, microservices, and at least one major cloud platform (AWS, GCP, or Azure).
- Ability to work cross-functionally with ML, data, infra, and product teams, and to communicate clearly about system behavior, quality, and risk.
- Experience with vendor integration and VPC deployment.
- An AI-Native Engineering Mindset who uses AI tools as a core part of their own workflow to accelerate design, development, testing, and code review.
Nice to have
- Hands-on experience with ML/LLM observability and evaluation tools (e.g., Arize, Braintrust, LangFuse, Weights & Biases, Galileo, Vertex AI Model Monitoring, SageMaker Model Monitor).
- Experience building or shipping LLM/GenAI applications and evaluating them: prompt/result logging, evaluation metrics, LLM-as-a-judge, and human-in-the-loop review.
- Experience evaluating agentic systems: tool use, multi-step reasoning, and trajectory/task-success measurement.
Additional information
To learn more about our AI Platform, you can review the relevant talks/blog posts on the Netflix AI Platform Research website.
Pay and benefits
Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $500,000.00 - $860,000.00. This compensation range will vary based on location.
Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here.
Netflix is a unique culture and environment.
Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.
We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully.
Job is open for no less than 7 days and will be removed when the position is filled.
About Netflix
At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what’s next.
Equal opportunity and legal notices
We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.
From Netflix's careers page, first listed on Rolev.ai on November 20, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Software Engineer 5, AI Observability role at Netflix, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
- Software Engineer SalesforceSysco · Houston, TX
- Software Engineer II - Location is HYBRID in either Dallas, TX or Denver, COAT&T · Denver, CO · $70k – $116k/yr
- Software Engineering InternL3Harris · Rochester, NY
- Software Engineer GEN AI, Assistant Vice PresidentCitigroup · Irving, TX · $107k – $161k/yr
- Software Engineer - Developer ( Experienced or Lead)Boeing · Chantilly, VA · $135k – $183k/yr
- Software Engineer (Senior Member) - RustL3Harris · Camden, NJ · $118k – $225k/yr
Common questions
What is the salary for the Software Engineer 5, AI Observability role at Netflix?
The Software Engineer 5, AI Observability posting at Netflix states compensation of $500,000 – $860,000 per year. Final pay may depend on location, experience, and interview evaluation on Netflix's official career site.
Where is the Software Engineer 5, AI Observability job at Netflix located?
Yes, this Software Engineer 5, AI Observability opening at Netflix is listed as Remote (US). Always check Netflix's application page for specific state eligibility or relocation policies.
How do I apply for the Software Engineer 5, AI Observability position at Netflix?
This listing links directly to Netflix's application page. You can apply directly on Netflix's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.