AI Product Engineer

About the role

Location: New York, NY | Practice Area: Technology & Engineering | Type: Permanent, Full-Time | Level: CO

Reimagine business processes and build the next generation of AI-powered solutions using Large Language Models, agentic AI, and Generative AI technologies.

The Role

Capco is seeking an AI Product Engineer to help design, develop, and deliver innovative AI-powered products and solutions that transform how businesses operate. This role combines product thinking, hands-on technical capabilities, and client engagement to identify opportunities where AI can streamline workflows, automate processes, and create meaningful business value.

You will work directly with clients, business stakeholders, product managers, and engineering teams to understand business challenges, reimagine existing processes, and translate opportunities into practical AI-powered solutions. You will help shape product requirements, develop prototypes, and guide solutions from initial concept through implementation.

This opportunity is suited to someone who enjoys solving business problems and working at the intersection of AI technology, product development, and business transformation. The role requires working proficiency in Python and SQL, with a primary focus on product innovation, problem-solving, and delivering business outcomes rather than traditional software engineering.

What You'll Do

• Partner with clients and business stakeholders to understand existing processes, identify inefficiencies, and redesign workflows using AI, including Generative AI, intelligent automation, and agentic solutions.
• Identify, evaluate, and prioritize AI use cases based on business value, technical feasibility, user experience, and implementation complexity, translating opportunities into product requirements, user stories, and actionable development plans.
• Design and prototype AI-powered products using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, Python, SQL, APIs, and modern AI tools to validate concepts and demonstrate business value.
• Collaborate with AI engineers, developers, designers, and business teams throughout the product lifecycle, facilitating client workshops, gathering requirements, testing solutions, and supporting implementation.
• Evaluate product performance, gather user feedback, and recommend improvements to usability, accuracy, efficiency, and business impact while staying informed about emerging AI technologies and capabilities.

What We're Looking For

• 2-3 years of relevant professional experience in AI product development, product management, business analysis, technology consulting, AI engineering, or a related field.
• Hands-on experience with Generative AI technologies, Large Language Models, and platforms such as OpenAI, Anthropic, Gemini, Azure OpenAI, or comparable solutions, including familiarity with prompt engineering, RAG, AI agents, and LLM-based applications.
• Working proficiency in Python and SQL, including the ability to independently write scripts, manipulate data, interact with APIs, and develop lightweight prototypes or proof-of-concepts. Advanced software engineering expertise is not required.
• A product-focused approach with the ability to understand business needs, analyze processes, define requirements, prioritize features, and identify opportunities for AI-enabled workflow improvements and intelligent automation.
• Effective analytical, problem-solving, communication, and collaboration skills, with the ability to engage clients, explain technical concepts to non-technical stakeholders, and contribute across discovery, prototyping, testing, and deployment.
• Willingness to work hybrid, 3 days per week, in NY office.

Bonus Points For

• Experience in client-facing consulting environments, particularly within financial services, banking, or capital markets, including presenting AI demonstrations or product recommendations to stakeholders.
• Exposure to AI product management, product roadmaps, Agile methodologies, backlog prioritization, user stories, and tools such as Jira or Confluence.
• Experience developing AI prototypes or workflows using LangChain, LangGraph, CrewAI, Microsoft Copilot Studio, or comparable technologies, including low-code/no-code platforms such as Power Automate, n8n, or Zapier.
• Familiarity with RAG architectures, vector databases, enterprise knowledge management, cloud platforms such as AWS, Azure, or Google Cloud, and AI evaluation or responsible AI principles.
• Experience with process mapping, business process optimization, digital transformation, workflow automation, and human-in-the-loop approaches.

Benefits

We offer a competitive, people-first benefits package designed to support every aspect of your life:

• Healthcare Coverage: Medical, dental, and vision benefits to support your health and wellbeing.
• Retirement Savings: 401(k) matching to help you plan for your financial future.
• Family-Friendly Benefits: Maternity and paternity leave, alongside dependent care benefits.
• Financial Wellbeing: Health Savings Accounts (HSA) and Flexible Spending Accounts (FSA).
• Continuous Learning: Tuition reimbursement to support your professional development.
• Wellness Support: Wellness reimbursement to support your personal wellbeing.
• Commuter Benefits: Support for eligible commuting expenses.
• Extra Perks: Access to Working Advantage, a discounted marketplace offering savings on a range of products and services.

Inclusion at Capco

• We're committed to making our recruitment process accessible and straightforward for everyone.
• If you need any adjustments at any stage, just let us know - we'll be happy to help.
• We value each person's unique perspective and contribution.
• At Capco, we believe that being yourself is your greatest strength.
• Our #BeYourselfAtWork culture encourages individuality and collaboration - a mindset that shapes how we work with clients and each other every day.

Use of Artificial Intelligence in Talent Acquisition

At Capco, we use artificial intelligence (AI) tools to support and enhance several parts of talent acquisition. This includes using AI-enabled features within LinkedIn to help source potential candidates, speeding up routine recruitment communications such as emails and creating compelling and brand-aligned job postings that accurately reflect role requirements, and AI-scheduling applications to improve the efficiency of interview coordination.

AI is used as a support tool only. All hiring decisions are made by talent acquisition and hiring teams.

• We have been informed of several recruitment scams targeting the public.
• We strongly advise you to verify identities before engaging in recruitment related communication.
• All official Capco communication will be conducted via a Capco recruiter.

• #LI-MB1
• #LI-HYBRID
• US Pay Range $93,000 - $112,000 USD