Sr. Staff Software Engineer, Cribl AI

About the role

Join the company that's building the telemetry infrastructure for the AI era. At Cribl, we partner with IT and Security teams at many of the world's biggest enterprises, including half of the Fortune 100, to bridge the gap between AI ambition and infrastructure reality. As the AI Platform for Telemetry, we give customers the choice, control, and flexibility to manage and analyze telemetry for both humans and agents, so they can build what's next.

We're one of the fastest-growing private companies and a leading player in a massive, fast-moving market. With a global workforce, we're remote-first and grounded in a simple idea: software is a people business. Cribl is the place where curious, collaborative people can do their best work, grow fast, and bring their full selves to the herd.

If You've Got It - We Want It

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience, with 7+ years of software engineering experience.
• Strong experience designing, building, and operating distributed systems, scalable backend services, or cloud-native infrastructure.
• Proficiency in one or more programming languages, such as Go, Python, or TypeScript.
• Experience building, integrating, or operating production AI/ML systems, including NLP, speech/voice or MLOps based platforms.
• Experience with AI/ML infrastructure or LLM application architectures, such as model routing, inference platforms, MCP, RAG, or evaluation frameworks.
• Experience with cloud infrastructure, API design and production observability.
• Understanding of performance optimization, scalability, reliability, and operational troubleshooting in production environments.
• Ability to independently drive technical initiatives, make architectural tradeoffs, and collaborate with Product, Research, and Engineering leadership.
• Strong problem solving skills and the ability to navigate ambiguity while maintaining focus on customer and business outcomes.

Nice to Have

• Hands on experience with model inference runtimes such as ONNX, NVIDIA Triton, vLLM, or TensorRT-LLM.
• Experience deploying and optimizing ML models across cloud infrastructure, GPUs, or resource constrained edge devices.
• Familiarity with inference optimization techniques, including quantization, dynamic batching, KV cache and hardware aware scheduling to improve latency, throughput, and cost efficiency.
• Experience with model serving, inference benchmarking, performance profiling, and detecting model quality or performance regressions.
• Experience building or operating high throughput, low latency inference systems at scale.
• Familiarity with fine tuning, model optimization, or deploying custom NLP, speech, or other ML models.
• Experience with distributed tracing, AI observability and inference optimizations.
• Experience designing secure, multi tenant platforms, workload isolation, and resource management.
• Contributions to open source AI infrastructure, inference frameworks, or developer tooling.

• #LI-AM1
• #LI-Remote
• The salary for this role is dependent on geographic location and will be based on the individual candidate's job-related knowledge, skills, and experience.

Pay and benefits

In addition to base salary, for sales and some sales-adjacent roles, employees are eligible to earn incentive compensation (commission). For all other roles, employees are eligible to participate in the Cribl Corporate Bonus Program.

In addition to a competitive salary, Cribl also offers a generous benefits package which includes health, dental, vision, short-term disability, and life insurance, paid holidays and paid time off, a fertility treatment benefit, 401(k), and equity.

Base Salary Range $250,000 - $300,000 USD

Bring Your Whole Self

Diversity drives innovation, enables better decisions to support our customers, and inspires change for the better. We're building a culture where differences are valued and welcomed, and we work together to bring out the best in each other.

Interested in joining the Cribl herd? Learn more about the smartest, funniest, most passionate goats you'll ever meet at cribl.io/about-us.