Senior AI Engineer
- Location
- McLean, VA · Hybrid
- Job type
- Full-time
- Level
- Senior
- Experience
- 8+ years
- Listed
- Today
Skills & highlights for this role
- TS/SCI clearance
- Python
- LangGraph
- RAG architectures
- vector databases
- prompt engineering
Also useful
- AutoGen
- CrewAI
- fine-tuning open-source LLMs
- FedRAMP
How well does your resume fit this job?
Upload your resume to see your score for this Rohirrim role, what matches, what's missing, and your best other matches.
Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.
About the role
Note: This is a Hybrid Role - 3 days per week in our office in McLean, VA
What You'll Do
Agent Design & Development
- Architect and build multi-agent systems and autonomous workflows for document analysis, requirement extraction, RFP response generation, and procurement pipeline automation.
- Design and implement agentic orchestration using frameworks such as LangGraph, AutoGen, CrewAI, or custom-built solutions tailored to Rohirrim's platform requirements.
- Develop tool-using, reasoning, and planning capabilities that enable agents to decompose complex acquisition problems into executable subtasks.
- Build robust human-in-the-loop and approval gates for high-stakes decision points within automated workflows.
Graph RAG & Document Intelligence
- Design and optimize Retrieval-Augmented Generation (RAG) pipelines to ground agent outputs in authoritative procurement data, regulations (FAR/DFARS), past performance records, and institutional knowledge.
- Implement advanced retrieval strategies including hybrid search, re-ranking, and context-aware chunking across large, heterogeneous document corpora.
- Develop document parsing and structuring pipelines for RFPs, SOWs, PWS, solicitations, and other complex government acquisition artifacts.
LLM Integration & Evaluation
- Select and integrate appropriate LLMs (commercial and open-source) for specific agent tasks, balancing capability, latency, cost, and security requirements.
- Build evaluation frameworks to systematically test agent accuracy, hallucination rates, and task completion against procurement-specific benchmarks.
- Implement prompt engineering best practices, including structured outputs, chain-of-thought reasoning, and few-shot prompting optimized for acquisition workflows.
Platform & Infrastructure
- Collaborate with platform engineers to deploy agents in production with observability, logging, tracing, and graceful failure handling.
- Contribute to shared tooling, internal SDKs, and reusable agent components that accelerate development across the engineering team.
- Participate in architecture reviews, code reviews, and technical planning sessions with a focus on scalability and maintainability.
What You'll Bring
Required
- 8+ years of software engineering experience, with at least 1 year focused on LLM applications, AI agents, or applied ML systems in production.
- Strong Python proficiency; experience building production-grade AI/ML pipelines.
- Hands-on experience with LLM orchestration frameworks (LangChain, LangGraph, AutoGen or equivalent).
- Deep understanding of RAG architectures, vector databases (Pinecone, Weaviate, pgvector or similar), and embedding models.
- Experience integrating APIs from frontier model providers and tuning prompts for structured and reliable results
- Strong software engineering fundamentals: clean architecture, testing, observability, and version control best practices.
Plusses
- Experience building AI products for regulated enterprise environments.
- Familiarity with federal acquisition regulations (FAR, DFARS) or proposal management processes.
- Experience with fine-tuning or instruction-tuning open-source LLMs (LLaMA, Mistral, etc.).
- Knowledge of secure-by-design principles and air-gapped or FedRAMP-compliant deployment environments.
- Active Secret or TS/SCI security clearance (or ability and eligibility to obtain).
- Experience with cloud infrastructure on AWS, Azure, or GCP; containerization with Docker/Kubernetes.
Success Profile
- A collaborative IC that is excellent at giving and receiving technical feedback, communicating trade-offs clearly, and elevating teammates.
- Ability to help define how agentic AI gets implemented in a SaaS compan y
The Opportunity
At Rohirrim, we're building the AI that powers how the government buys - from billion-dollar weapons systems to the software that keeps agencies running. Acquisition is slow, paper-heavy, and consequential; we're using agentic AI to make it faster and more defensible without lowering the bar on rigor. Your work will ship into production environments where the decisions really matter.
We're looking for a talented, self-driven Agentic AI Engineer to join our core engineering team and help build the next generation of autonomous AI systems that power our acquisition platform. You will design, develop, and deploy sophisticated multi-step AI agents capable of reasoning over complex procurement documents, managing long-horizon workflows, and delivering precise, defensible outputs in high-stakes environments.
This is a hands-on individual contributor role. You will work closely with our ML researchers, full-stack engineers, and product teams to ship agentic features that directly impact how government agencies and enterprise organizations acquire capabilities. Your work will be used in production environments handling sensitive and consequential decisions, so rigor, reliability, and security-consciousness are as important as innovation.
From Rohirrim's careers page, first listed on Rolev.ai on November 18, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Senior AI Engineer role at Rohirrim, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Technical Lead, Data EngineeringRevance · Nashville, TN
- Senior Product Engineer, McLean, VAAppian Corporation · McLean, VA
- Staff Software Engineer, Tools - Central Technology, Unreal EcosystemRiotgames · Los Angeles, CA
- Software Engineering Intern (Winter '27)Kira · San Francisco, NY
- Fullstack Software Engineer - Embedded PaymentsXplor · Kansas City, MO · $95k – $105k/yr
- Forward Deployed Engineer, PaymentsPolygon Labs · Remote (US)
Common questions
Where is the Senior AI Engineer job at Rohirrim located?
This Senior AI Engineer position at Rohirrim is located in McLean, VA (Hybrid). Always check Rohirrim's application page for specific state eligibility or relocation policies.
What qualifications are required for Senior AI Engineer at Rohirrim?
For the Senior AI Engineer role, Rohirrim highlights 8+ years of relevant experience; experience with Python, LangGraph, RAG architectures, vector databases, prompt engineering. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Senior AI Engineer position at Rohirrim?
This listing links directly to Rohirrim's Rippling application page. You can apply directly on Rohirrim's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Rippling application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.