Lead AI Software Engineer

About The Role

The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.

What You Might Do

• Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
• Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
• Optimize data pipelines and storage solutions for real-time AI inference and processing.
• Implement security and privacy best practices for distributed AI systems.
• Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
• Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Develop robust logging, monitoring, and alerting systems to ensure system reliability.

Essential Qualifications

• 10+ years of experience in backend software development, with strong proficiency in Java, C++, or Python.
• Proficient in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
• Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
• Experience building distributed systems, microservices, and cloud-native applications.
• Strong knowledge with building secure, privacy-aware interfaces between models, devices, and external services.
• Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
• Strong problem-solving skills and ability to work in a fast-paced, agile environment.

Preferred Skills

• Experience with AI model deployment and integration into backend services.
• Knowledge of edge computing, networking, and security best practices.
• Exposure to cloud-edge hybrid architectures and distributed AI workloads.
• Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.

Compensation & Benefits (Full-Time Employees)

The salary range for this role is listed above. Final salary offered is based upon multiple factors including individual job-related qualifications, education, experience, knowledge and skills.

Benefits

At HP IQ, we offer a competitive and comprehensive benefits package, including:

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave (US benefits overview)