Core Compete
Direct Workday career site

AI Large Language Model (LLM) Engineer

Location
United States · On-site
Job type
Full-time
Level
Senior
Education
Bachelor's degree
Listed
3 days ago

Skills & highlights for this role

  • software engineering fundamentals
  • generative AI
  • classical machine learning
  • agent orchestration
  • retrieval-augmented generation (RAG)
  • vector databases
  • embedding generation
  • model fine-tuning
  • transformer architectures
  • evaluation harnesses

Also useful

  • open source AI frameworks
  • model serving
  • guardrails and content filtering
  • prompt injection defense
  • enterprise security, observability, and governance

About the role

As a hands on AI Engineer, you will be at the heart of designing and building the components that make up advanced AI systems powering the modern enterprise. This is a deeply technical, hands-on engineering role - you will spend the majority of your time in the detailed design, development, integration, and testing of AI system components across classical machine learning, generative AI, and agentic systems, delivering these within active client engagements.

You will take detailed architecture and design specifications and translate them into working, production-quality software components. This means writing clean, well-structured code, making low-level design decisions within your assigned scope, and ensuring your components integrate reliably within the broader AI system. You will build and wire together the constituent parts of AI agent systems - including individual agent logic, tool integrations, skills, and memory components - and contribute to the development and integration of foundation and classical ML models into end-to-end pipelines.

A hands-on curiosity for the open source ecosystem is essential in this role. You will continuously evaluate, learn, and adopt relevant open source libraries and frameworks - such as those spanning agent orchestration, vector storage, model serving, and ML pipelines - selecting and applying the right ones for the problem at hand.

Equally, you will configure, integrate, and operationalize third-party AI technologies and platform services, understanding their capabilities and constraints deeply enough to make them work reliably within the context of a larger enterprise system.

You will engineer components with enterprise-grade qualities in mind, ensuring your work meets defined requirements across security, observability, governance, performance, and scalability.

You will write and maintain the technical artifacts that accompany your engineering work - including low-level design documents, component specifications, and integration contracts - ensuring your work is well-documented, testable, and handoff-ready.

You will operate as a practitioner within cross-functional delivery teams alongside data engineers, ML engineers, and application developers, taking direction from lead and principal architects while contributing meaningfully to technical problem-solving and design discussions within your domain.

This role is an opportunity to build deep, hands-on expertise across the AI engineering stack, develop strong software engineering fundamentals applied to cutting-edge AI systems, and grow toward a lead engineer or architect role over time.

The Work

  • Design, build, and configure individual agents - including their prompts, tools, and skills - and integrate them into multi-agent workflows
  • Implement agent orchestration logic that handles task handoffs, communication, and error recovery
  • Build evaluation harnesses and test suites that measure agent and component quality on metrics such as accuracy, relevance, and faithfulness, and share findings to inform design improvements
  • Integrate foundation models into applications, selecting the appropriate model and invocation pattern for each use case
  • Build and run model fine-tuning pipelines - including data preparation and training - to adapt models to specific business domains, applying working knowledge of transformer-based architectures
  • Build ingestion pipelines that parse, chunk, enrich, and index unstructured enterprise content for retrieval
  • Implement embedding generation, integrate vector databases, and develop retrieval components, including connectors and adapters that process unstructured content into end-to-end RAG pipelines
  • Build the logic that assembles prompts and manages what information is passed to the model within its context window
  • Implement memory components that store and recall conversational history and other relevant context
  • Implement input/output guardrails, content filtering, and defenses against prompt injection
  • Build PII detection and redaction components and integrate access controls for model and tool access
  • Implement versioning, audit logging, and lineage tracking, and maintain model documentation that keeps the system auditable
  • Instrument components with logging and tracing for requests, responses, token usage, and tool calls
  • Contribute to monitoring, alerting, and cost tracking that keep AI systems healthy in production
  • Continuously learn and apply new design patterns, technologies, and frameworks across the fast-evolving AI landscape, bringing fresh approaches to the components you build
  • Collaborate within cross-functional teams to clarify requirements and ensure your components meet stakeholder needs
  • Create and maintain clear technical documentation for the components you build, supporting troubleshooting and future development

Education

  • Bachelor's Degree in Computer Science, Computer Engineering, Data Science, or a related engineering discipline

Basic (Required) Qualification

  • Experience (work or coursework) in designing, coding, building advanced AI solutions using agentic, generative and classical AI/ML using at least one cloud vendor.
  • Experience (work or coursework in the Agentic, LLM and Generative AI space.
  • Experience (work or coursework) architecting and operationalizing LLM driven application architecture patterns.
  • Experience in coding and engineering, machine learning, deep learning and NLP solutions and applications.
  • Coding experience using Python

About Accenture

Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services-creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries.

Technology is at the core of change today, and we are one of the world's leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability.

Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Read the original posting

From Core Compete's careers page, first listed on Rolev.ai on November 14, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this AI Large Language Model (LLM) Engineer role at Core Compete, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the AI Large Language Model (LLM) Engineer job at Core Compete located?

This AI Large Language Model (LLM) Engineer position at Core Compete is located in United States (On-site). Always check Core Compete's application page for specific state eligibility or relocation policies.

What qualifications are required for AI Large Language Model (LLM) Engineer at Core Compete?

For the AI Large Language Model (LLM) Engineer role, Core Compete highlights a bachelor's degree; experience with software engineering fundamentals, generative AI, classical machine learning, agent orchestration, retrieval-augmented generation (RAG), vector databases. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.

How do I apply for the AI Large Language Model (LLM) Engineer position at Core Compete?

This listing links directly to Core Compete's Workday application page. You can apply directly on Core Compete's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Workday application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.