Agentic AI Architect
- Pay
- $149,100 – $238,200 per year
- Location
- San Jose, CA
- Listed
- Today
About the role
We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.
This role sits at the intersection of
- Large Language Models (LLMs)
- Agent frameworks & autonomous systems
- Retrieval-Augmented Generation (RAG)
- Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration.
Key Responsibilities
AI Architecture & System Design
- Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
- Architect RAG pipelines for enterprise-scale knowledge integration
- Define end-to-end AI system architecture from data ingestion -> reasoning -> action
Agentic AI & LLM Development
- Develop advanced workflows using:
- tool-using agents
- planning & reasoning agents
- multi-agent collaboration frameworks
- Evaluate and integrate leading LLMs (open-source and proprietary)
- Optimize prompt engineering, memory, and reasoning capabilities
Hardware-Aware AI Optimization
- Co-design AI systems with:
- FPGA acceleration
- ASIC platforms
- heterogeneous compute (CPU/GPU/FPGA)
- Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
- Collaborate with hardware teams on EDA and system integration
Framework & Platform Development
- Build internal platforms using
- LangChain
- LlamaIndex
- custom agent orchestration framework
- Develop reusable components for:
- memory management
- tool integration
- knowledge retrieval
Technical Leadership
- Lead architecture reviews and guide engineering teams
- Mentor senior engineers and influence cross-functional teams
- Drive innovation in AI + hardware convergence
What Makes This Role Unique
- Opportunity to define agentic AI architecture for hardware-driven systems
- Work at the convergence of:
- AI reasoning systems
- FPGA acceleration
- next-generation computing platforms
- High-impact role influencing future AI + semiconductor integration
You will help shape how AI agents interact with hardware, enabling
- intelligent system orchestration
- real-time decision-making pipelines
- scalable AI deployment on FPGA platforms
Summary
This role is ideal for a senior technical leader who can
- bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture
- and drive innovation in next-generation AI systems.
The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.
$149.1K - $238.2K USD
We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.
Qualifications
- Master's or Bachelor's degree with 10+ years of experience in one or more of the following:
- AI/ML systems
- Distributed systems
- Hardware-software co-design
- Recognized expertise in AI/ Large Language Models (LLMs)
- Deep understanding of:
- LLM architectures and inference
- RAG systems and vector databases
- Agentic AI / autonomous agents
- Hands-on experience building:
- Production-grade LLM applications
- Multi-step reasoning and orchestration workflows
- Scalable and reliable AI systems in production
- Strong background in:
- FPGA / ASIC / EDA systems
- Heterogeneous computing architectures
- Familiarity with:
- Hardware acceleration for AI workloads
- Performance optimization across system stack
Technical Skills
- Programming:
- Python
- C++ (preferred)
- Experience with:
- Distributed systems design
- APIs and microservices architecture
- Cloud and/or edge AI deployment
- Hands-on experience with:
- LLM fine-tuning, quantization, and model distillation
- On-device / edge AI deployment
- Robotics, autonomous systems, or real-time AI pipelines
- Knowledge of:
- Compiler stacks (e.g., MLIR, TVM)
- AI model optimization for FPGA platforms
- Job Type: Regular
- Shift: Shift 1 (United States of America)
- Primary Location: San Jose, California, United States
Equal opportunity and legal notices
All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.
From Altera's careers page, first listed on Rolev.ai on November 17, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Agentic AI Architect role at Altera, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
- Agentic AI EngineerDefense Unicorns · Springfield, VA
- Agentic AI Quality EngineerCore Compete · United States
- Agentic AI Architect-Anthropic-US EastNewrocket · Remote Eastern
- Agentic AI EngineerBah · McLean, VA
- Agentic AI Systems Evaluation EngineerHp · Houston, TX
- Agentic AI Harness Architect - MoveworksServiceNow · Mountain View, CA · $201k – $352k/yr
Common questions
What is the salary for the Agentic AI Architect role at Altera?
The Agentic AI Architect posting at Altera states compensation of $149,100 – $238,200 per year. Final pay may depend on location, experience, and interview evaluation on Altera's official career site.
Where is the Agentic AI Architect job at Altera located?
This Agentic AI Architect position at Altera is located in San Jose, CA. Always check Altera's application page for specific state eligibility or relocation policies.
How do I apply for the Agentic AI Architect position at Altera?
This listing links directly to Altera's Workday application page. You can apply directly on Altera's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Workday application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.