Large Language Model Architect
- Location
- Remote (US)
- Job type
- Full-time
- Level
- Executive
- Experience
- 15+ years
- Listed
- 3 days ago
Skills & highlights for this role
- Large Language Models (LLMs)
- retrieval-augmented generation
- enterprise architecture
Also useful
- Gemini Enterprise
- Vertex AI
- Google Cloud
About the role
Project Role: Large Language Model Architect
Project Role Description
Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data.
Must have skills
Large Language Models (LLMs)
Good to have skills: NA
Minimum 15 year(s) of experience is required
Educational Qualification
- 12 to 18 years of overall experience in enterprise technology delivery
- 5 years of experience in cloud solution or enterprise architecture
Summary
We are seeking a Senior Enterprise AI Architect to lead the strategy, architecture, and delivery of enterprise AI solutions using Gemini Enterprise, Google Cloud, Vertex AI, and agent platforms.
The architect will translate business priorities into secure, scalable, reliable, and measurable AI-enabled experiences, including enterprise search, knowledge assistants, copilots, and AI agents. The role will be responsible for solution architecture, technical governance, production readiness, adoption, and business value realization across complex enterprise environments.
Roles & Responsibilities
Business and Solution Strategy
- Lead discovery and architecture workshops to identify, assess enterprise AI use cases.
- Translate business objectives into a solution roadmap, delivery scope, architecture, estimates, dependencies, risks, and measurable success criteria.
- Advise stakeholders on when to use enterprise search, knowledge assistants, copilots, deterministic automation, AI agents, or a combination of these patterns.
Architecture and Platform Design
- Design end-to-end enterprise AI architectures across Gemini Enterprise, enterprise search, connectors, retrieval services, custom agents, APIs, integration services, models, tools
- Make architecture decisions regarding platform configuration, low-code extension, custom development, and integration with existing enterprise systems.
- Define reference architectures, reusable patterns, architecture decision records, and technical standards for enterprise AI solutions.
- Design for scalability, performance, reliability, maintainability, interoperability, & cost efficiency
Enterprise Knowledge and Retrieval
- Define the enterprise knowledge architecture, including source-system onboarding, content ingestion, metadata, indexing, refresh, synchronization, retention, and deletion
- Design retrieval-augmented generation patterns using semantic search, hybrid search, embeddings, reranking, grounding, and contextual retrieval.
- Establish identity mapping, source-permission enforcement, document-level access controls, and security trimming across enterprise knowledge sources.
- Guide the use of structured data, unstructured content, semantic models, taxonomies, ontologies, and knowledge graphs where appropriate.
- Define controls to maintain freshness, relevance, traceability, and source attribution for AI-generated responses.
Agent and Integration Architecture
- Design enterprise AI agents and multi-agent solutions, including orchestration, tool/function calling, memory, planning, approvals, and human-in-the-loop controls.
- Define secure integration patterns across enterprise applications, APIs, data sources, and business platforms, including identity, authorization, and delegated access controls.
- Establish governance and guardrails for agentic solutions, covering security, risk management, approval workflows, safe automation, and responsible action execution
Responsible AI, Security, and Governance
- Establish Responsible AI and governance standards covering privacy, security, safety, compliance, explainability, auditability, and human oversight.
- Define security, risk, and control frameworks for enterprise AI solutions, including agent governance, prompt security, data protection, threat modelling, and regulatory compliance.
- Implement monitoring, traceability, and audit mechanisms across AI interactions, retrieval systems, agent actions, tool execution, and business workflows.
Evaluation and Production Readiness
- Define evaluation standards and production acceptance criteria for AI solution quality, safety, grounding, reliability, and effectiveness.
- Establish production architecture standards covering scalability, performance, observability, security, cost, and operational readiness.
- Implement LLMOps practices including evaluation, testing, prompt and model lifecycle management, CI/CD, release governance, and production monitoring
Engineering and Technical Leadership
- Lead and mentor engineering teams through the end-to-end delivery of enterprise AI solutions, from ideation and prototyping through production deployment and support.
- Provide architecture governance + hands-on tech leadership through design, code, security, infrastructure & deployment reviews, while developing reusable patterns and accelerators
Client and Delivery Leadership
- Lead client architecture discussions and communicate complex technical decisions to business and technology stakeholders
- Contribute to pre-sales activities, proposals, estimations, solution shaping, demonstrations, and architecture presentations
- Manage architecture risks, dependencies, assumptions, non-functional requirements, and technical decision points
- Professional & Technical Skills: Google Cloud and Enterprise AI
- Strong Google Cloud architecture experience, with practical exposure to Gemini, Vertex AI, or equivalent enterprise AI capabilities.
- Understanding of enterprise AI platform architecture, model consumption patterns, data boundaries, quotas, performance considerations, and cost management.
GenAI, Search, and Agentic AI
- Gemini Enterprise, Google Agent space, Vertex AI, or equivalent enterprise AI platform experience.
- Experience designing enterprise search and knowledge-assistant solutions
- Understanding of prompt engineering, context management, model limitations, hallucination risks, evaluation approaches, and AI safety controls.
Enterprise Architecture and Integration
- Strong enterprise architecture expertise across application, integration, data, security, identity, cloud, and AI domains, with experience producing solution blueprints and architecture governance artifacts.
- Experience integrating enterprise platforms and data sources using APIs, connectors, event-driven architectures, data pipelines, and custom services.
- Deep understanding of enterprise AI patterns including RAG, semantic search, enterprise search, grounding, retrieval, and agent architectures.
- Ability to assess business requirements and determine when to apply GenAI, agentic AI, traditional automation, or custom solution approaches.
Preferred Experience
- AI agent design and implementation, including multi-agent orchestration, MCP, A2A, ADK, and agent runtimes.
- Enterprise search, knowledge management, taxonomy, ontology, and knowledge-graph solutions.
- GenAI governance, evaluation, observability, safety, and Responsible AI frameworks.
- Experience across leading enterprise AI ecosystems (e.g., Microsoft Copilot, Azure AI, Amazon Q, OpenAI, Anthropic) and relevant cloud/AI certifications.
Additional Information
- The candidate should have minimum 15 years of experience in Large Language Models (LLMs).
- This position is based at our Bengaluru office.
- A background of 12 to 18 years of overall experience in enterprise technology delivery and 5 years of experience in cloud solution or enterprise architecture is required.
About Accenture
Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services-creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries.
Technology is at the core of change today, and we are one of the world's leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability.
Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
Equal opportunity and legal notices
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
From Core Compete's careers page, first listed on Rolev.ai on November 14, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Large Language Model Architect role at Core Compete, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Software Developer jobs- Senior Platform Software EngineerPure Storage · Santa Clara, CA
- Software EngineerHearst · Salem, NC
- Senior Software Engineer III (6708)Metrostar · Reston, VA
- Product Engineer (Remote - US CT/ET)Zen Educate · Chicago, IL
- Embedded Firmware EngineerWright Electric Inc. · Ballston Spa, NY
- Senior Software EngineerExactrx · Brentwood, TN
Common questions
Where is the Large Language Model Architect job at Core Compete located?
Yes, this Large Language Model Architect opening at Core Compete is listed as Remote (US). Always check Core Compete's application page for specific state eligibility or relocation policies.
What qualifications are required for Large Language Model Architect at Core Compete?
For the Large Language Model Architect role, Core Compete highlights 15+ years of relevant experience; experience with Large Language Models (LLMs), retrieval-augmented generation, enterprise architecture. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Large Language Model Architect position at Core Compete?
This listing links directly to Core Compete's Workday application page. You can apply directly on Core Compete's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Workday application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.