Core Compete
Direct Workday career site

AI LLM Architect

Location
United States
Listed
3 days ago

You Are

As an experienced and Senior AI/ LLM Architect, you will play a pivotal role in designing and delivering end-to-end AI platform architectures that power the modern, reinvented enterprise.

Operating at the intersection of business and engineering, you will own the technical design of advanced AI systems spanning classical machine learning, generative AI, and agentic systems ensuring they are purposefully architected to meet client business objectives and enterprise-grade standards.

Within this scope, you will take deep ownership of one or more critical architecture domains such as agentic application design, AI security and trust, AI operations and observability, data and knowledge engineering, or model platforms and inference serving as the lead authority in your domain across client engagements.

The Work

  • Translate business strategy into a technical vision by defining the non-functional requirements (NFRs) necessary to meet operational goals for performance, reliability, and cost.
  • Lead stakeholder workshops to align on technical feasibility, define project scope, and manage expectations with clients and leadership.
  • Drive the technology selection process, evaluating build-vs-buy decisions for AI platforms (e.g., Arize, LangSmith) and foundational models.
  • Architect model- and tool-agnostic multi-agent systems governed by an MCP Control Plane.
  • Design and implement the Agent Registry as the mandatory system of record and the AI Gateway for runtime policy enforcement.
  • Design and implement a certification gate to ensure no uncertified agents enter production, validating identity, policies, and evaluation metrics.
  • Design, implement, and abstract core agent services, including a first-class abstracted memory service with semantic, episodic, and procedural endpoints.
  • Architect the end-to-end data pipeline for AI systems, including data ingestion, preprocessing, and synchronization for fine-tuning and RAG.
  • Design and implement the context layer-spanning knowledge graphs, vector search, and semantic retrieval-to create reliable, grounded RAG pipelines.
  • Architect foundation model adaptation strategies, including dynamic, cost-and-performance-aware model routing and selection.
  • Design, implement, and prototype high-throughput, low-latency inferencing solutions using techniques like response caching and request batching.
  • Define security, governance, and observability as centrally-enforced, by-design controls for all AI systems.
  • Architect a robust, defense-in-depth security framework, including per-agent identity with IAM/IAP binding and layered guardrails.
  • Design and implement FinOps controls enforced at the AI Gateway, including token budgets, cost-center labeling, and threshold alerts.
  • Establish the framework for comprehensive system evaluation, adopting productized tools and instrumenting observability with OTel
  • Define and maintain the enterprise-wide AI reference architecture, reusable design patterns, and a library of approved software components.
  • Independently design, implement, build, and deliver proof-of-concept prototypes and foundational software components to validate architectural decisions.
  • Produce and own authoritative architecture artifacts, including blueprints, sequence diagrams, design specifications, and Architectural Decision Records (ADRs).
  • Mentor and guide cross-functional engineering teams (data, ML, application) on architectural best practices and design patterns.
  • Continuously research and integrate emerging AI patterns, frameworks, and technologies to maintain a forward-looking architecture.

Education

  • Bachelor's Degree or equivalent

Basic (Required) Qualification

  • Minimum of 2 years of experience in designing & deploying enterprise grade advanced ai solutions using agentic, generative and classical AI/ML using at least one cloud vendor.
  • Minimum of 2 years of experience in the Agentic, LLM and Generative AI space.
  • Minimum of 4 years of coding experience using python
  • Minimum of 2 years of experience architecting and operationalizing LLM driven application architecture patterns.
  • Minimum of 4 years in coding engineering, machine learning, deep learning and NLP solutions and applications.
  • Minimum of 4 years of experience as a machine learning architect in the industry designing big data, machine learning. large scale analytical engineering solutions.

Benefits of working at Accenture

  • 18 weeks paid parental leave
  • Long & short-term career break opportunities
  • Structured career development program
  • Local and international career opportunities.
  • Certified as a Family Inclusive Workplace™
  • Flexible Work Arrangements - centered around Accenture's Truly Human ethos and our commitment to supporting the health and wellbeing of our people.
  • We are proud to be in the top 3 of last year's Diversity & Inclusion Index!

We are a WORK180 Endorsed Employer, to see our benefits and policies

  • All our consulting professionals receive comprehensive training covering business acumen, technical and professional skills development.
  • You'll also have opportunities to hone your functional skills and expertise in an area of specialization.
  • We offer a variety of formal and informal training programs at every level to help you acquire and build specialized skills faster.

Learning takes place both on the job and through formal training conducted online, in the classroom, or in collaboration with teammates. The sheer variety of work we do, and the experience it offers, provide an unbeatable platform from which to build a career.

About Accenture

Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services-creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries.

Technology is at the core of change today, and we are one of the world's leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability.

Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Read the original posting

From Core Compete's careers page, first listed on Rolev.ai on November 14, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this AI LLM Architect role at Core Compete, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the AI LLM Architect job at Core Compete located?

This AI LLM Architect position at Core Compete is located in United States. Always check Core Compete's application page for specific state eligibility or relocation policies.

How do I apply for the AI LLM Architect position at Core Compete?

This listing links directly to Core Compete's Workday application page. You can apply directly on Core Compete's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Workday application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.