Member of Technical Staff - Inference
- Location
- San Francisco, CA · On-site
- Level
- Mid-level
- Listed
- 23 days ago
Skills & highlights for this role
- C++
- Python
- GPU architecture
- inference runtimes
Also useful
- CUDA
- Triton
- quantization
What you'll do
- Build and optimize the inference stack that runs personal AI models locally on Core.
- Improve latency, throughput, and memory efficiency across interactive requests and background agent workloads.
- Profile performance across the hardware and software stack, optimizing kernels, memory movement, and runtime execution.
- Build benchmarks that reflect real product workloads, including long contexts, concurrent agents, and sustained operation.
- Work closely with the hardware, post-training, and product teams.
Who you are
- Experience building or optimizing inference systems for language models.
- Strong systems programming skills in C++ or similar languages, alongside proficiency in Python.
- Familiarity with GPU architecture, memory management, and performance profiling.
- Experience with inference runtimes, quantization, or GPU kernel development using CUDA, Triton, or equivalent tools.
- Strong experimental judgment: you can identify bottlenecks and evaluate tradeoffs between speed, memory, power, and model quality.
- Ability to work on-site in San Francisco.
About Ghost
Ghost is a personal AI hardware company.
To realize the full benefit of what models will do for people, we believe an entirely new platform will be built around AI. Some devices will let your AI understand what is happening around you, others will enable you to get things done without navigating apps or menus.
As these systems become more capable and more personal, it matters who owns them. We’re building a future where that intelligence belongs to you, with an ecosystem of devices and software that gives you greater control over your time, attention, and the things you want to accomplish.
From Ghost's careers page, first listed on Rolev.ai on October 17, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Member of Technical Staff - Inference role at Ghost, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Software DeveloperAccenture Federal Services · Washington, DC · $97.5k – $115k/yr
- Software Developer 803Freedom Technology Solutions Group · Annapolis Junction, MD · $150k – $200k/yr
- Software DeveloperPurvis Systems · Newport, RI
- NASA Human Spaceflight Artificial Intelligence (AI) Software Engineer and Data ScientistCACI · Houston, TX
- Senior Manager Software EngineeringNasdaq · Atlanta, GA
- Software Engineering Supervisor - Test SystemsMoog · Torrance, CA
Common questions
Where is the Member of Technical Staff - Inference job at Ghost located?
This Member of Technical Staff - Inference position at Ghost is located in San Francisco, CA (On-site). Always check Ghost's application page for specific state eligibility or relocation policies.
What qualifications are required for Member of Technical Staff - Inference at Ghost?
For the Member of Technical Staff - Inference role, Ghost highlights experience with C++, Python, GPU architecture, inference runtimes. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Member of Technical Staff - Inference position at Ghost?
This listing links directly to Ghost's Ashby application page. You can apply directly on Ghost's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.