Principal Software Engineering Manager - AI Frameworks

About the role

Lead and develop a team of engineers working across multiple layers of the AI software stack, while staying technically engaged in architecture, design reviews, debugging, and critical implementation decisions that enable large-scale training and inference.

Drive performance and production outcomes by prioritizing and overseeing efforts to build, benchmark, profile, debug, validate, and optimize training and inference workloads, from developer workflows through production release.

Own build, release, and performance health by establishing best practices for build reliability, system observability, regression monitoring, release quality, impact measurement, developer velocity, time-to-deploy, and hardware efficiency. Partner cross-functionally with research, product, infrastructure, and hardware teams to deliver scalable, production-ready AI performance improvements.

Balance short-term delivery and long-term investments by advancing build, release, and validation automation, including AI-assisted workflows and closed-loop systems that identify issues, recommend or implement fixes, and verify outcomes. Ensure these investments align with organizational goals, platform roadmaps, and Azure capex objectives.

Build a strong engineering culture through coaching, feedback, hiring, and career development, enabling the team to operate with increasing autonomy and impact. Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Master's Degree in Computer Science or related technical field AND 10+ years of software engineering experience, including 6+ years in engineering management, OR Bachelor's Degree in Computer Science or related technical field AND 12+ years of software engineering experience, including 6+ years in engineering management, or equivalent experience. 4+ years people management experience.

Strong technical foundation in software engineering principles, computer architecture, GPU architecture, and hardware acceleration for neural networks, combined with hands-on experience in developer infrastructure such as build systems, dependency management, Bazel or comparable tooling, CI/CD, release engineering, and developer productivity.

Experience leading teams responsible for end-to-end performance analysis and optimization of LLMs, AI systems, or HPC workloads, including GPU profiling and performance analysis tools, and shipping validated builds through release pipelines into production environments. Demonstrated ability to lead cross-team initiatives, align stakeholders, and translate research or platform capabilities into scalable, production-ready solutions.

Proven people leadership skills, including hiring, coaching, performance management, and career development, with a track record of building high-performing, inclusive teams. Working knowledge of AI and ML systems across training, inference, evaluation, and benchmarking, with experience in at least one modern deep learning framework such as PyTorch, TensorFlow, or ONNX Runtime.

The candidate should be able to reason about how models, frameworks, runtimes, hardware, and developer infrastructure interact across the end-to-end lifecycle. Familiarity with GPU software stacks and acceleration technologies such as CUDA, ROCm, Triton, or equivalent, sufficient to guide technical direction and evaluate tradeoffs.

Experience designing advanced automation for build, test, release, benchmarking, and production validation workflows is preferred, including AI-assisted tooling and closed-loop systems that use observed results to drive subsequent actions.