Senior AI Serving Engineer, Backend
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Senior
- Experience
- 3+ years
- Education
- Bachelor's degree
- Listed
- 30 days ago
Skills & highlights for this role
- C++
- Python
- Kubernetes
- containerization
- MLOps infrastructure
Also useful
- vLLM
- SGLang
- TensorRT-LLM
- CUDA
- ROCm
Stated benefits & perks
- Medical
- Dental
- Vision
- 401k
- Flexible pto
About the Role
This role offers a unique opportunity to work on the core systems that power Sciforium’s multimodal AI models. You’ll help build the model serving platform working across C++, Python, runtime execution, and distributed infrastructure to create a fast, reliable engine for real-time AI applications.
You’ll gain hands-on experience with performance engineering, learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems engineers. If you enjoy low-level programming, care deeply about performance, and want exposure to the full AI stack, this role provides both high-impact work and strong growth potential.
What You'll Do
- Build the model serving platform, including API, Control Plane, Billing, Monitoring, and distributed inference features.
- Collaborate with ML researchers to integrate new multimodal models into production workflows.
- Write reliable, maintainable code with strong testing and documentation practices.
- Provide operational support for keeping our production services highly performant, available and reliable
- Help troubleshoot complex issues across runtime, service, and GPU layers, working closely with other engineers.
Ideal Candidate Profile
- Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
- 3+ years of software engineering experience, with a focus on infrastructure or machine learning systems.
- Strong proficiency in C++/Python/Go/Rust
- Experience with Kubernetes, Containerization
- Experience in building large scale ML/MLOps infrastructure
- Strong collaboration and communication skills, with the ability to work effectively across engineering and ML teams.
- Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.
Nice-to-have
- Experience with ML systems engineering, open source inference engine like vLLM, Sglang, or TRT-LLM
- Proficiency in CUDA or ROCm and experience with GPU profiling tools
- Contributions to open-source ML or HPC infrastructure
Benefits Include
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
About Sciforium
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
Equal opportunity and legal notices
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
From Sciforium's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Senior AI Serving Engineer, Backend role at Sciforium, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Senior AI Serving Engineer, Backend job at Sciforium located?
This Senior AI Serving Engineer, Backend position at Sciforium is located in San Francisco, CA (On-site). Always check Sciforium's application page for specific state eligibility or relocation policies.
What qualifications are required for Senior AI Serving Engineer, Backend at Sciforium?
For the Senior AI Serving Engineer, Backend role, Sciforium highlights 3+ years of relevant experience; a bachelor's degree; experience with C++, Python, Kubernetes, containerization, MLOps infrastructure. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Senior AI Serving Engineer, Backend position at Sciforium?
This listing links directly to Sciforium's Ashby application page. You can apply directly on Sciforium's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.