Software Engineer II - Core AI

Overview

Are you a software engineer who loves code, moves fast, and enjoys solving problems at scale? Are you excited about AI and want to build the platform that makes AI reliable, resilient, and effortless to operate at global scale?

Do you want to work with cutting-edge open-source and cloud technologies and build systems that are fault-tolerant, self-managing, self-healing, and highly scalable across public and private datacenters around the world? Do AI, Big Data, cloud infrastructure, Docker, Kubernetes, and distributed systems excite you?

If yes, come build with us.

Join the Azure Intelligent Container Platform team within CoreAI and help shape the infrastructure behind the next generation of AI-powered cloud services.

Azure AI Services enable customers to build intelligent applications with powerful capabilities to see, hear, speak, understand, and interpret using AI. Our mission is to transform these breakthrough AI technologies into production-ready, first-class Azure services—delivering the reliability, scale, simplicity, and performance customers need to bring AI innovations to life.

Responsibilities

This role offers end-to-end ownership and real-world impact. You will work closely with leading technology providers and engineering teams to bring cutting-edge AI technologies to Azure—from architecture and productization to platform engineering, deployment, performance, reliability, security, and customer experience.

You will solve challenging problems across the entire software stack and have the opportunity to influence both how the technology is built and how millions of customers experience AI at Azure scale.

You will

• Build for massive scale: Design and develop highly available, scalable distributed systems running across global public and private datacenters.
• Engineer for resilience: Build platforms that are fault-tolerant, self-managing, self-healing, and designed for operational excellence.
• Push cloud-native innovation: Leverage Docker, Kubernetes, open-source technologies, and cloud platforms to solve complex infrastructure challenges.
• Make AI production-ready: Turn rapidly evolving AI and cognitive technologies into reliable, secure, performant, and easy-to-use Azure services.
• Own the full lifecycle: Drive solutions from architecture and system design through implementation, testing, deployment, monitoring, and continuous improvement.
• Solve hard problems: Tackle challenges in distributed systems, performance, availability, scalability, security, privacy, and user experience.
• Ship technology that matters: Build products and platforms that enable AI experiences for customers around the world.

Required Qualifications

• AI-native mindset: Proficient in modern AI technologies and tools, with hands-on experience using generative AI, AI coding assistants/agents, and AI/ML frameworks in day-to-day engineering. You actively explore new AI capabilities and use AI to accelerate development, automate workflows, solve complex problems, and build smarter products.
• Strong engineering fundamentals: Excellent analytical and problem-solving skills, a strong quality mindset, and a passion for designing and building robust, maintainable, production-grade software.
• Education: BS/MS in Computer Science, Engineering, or a related technical field.
• Industry experience: 3–5+ years of experience in software development, architecture, system design, object-oriented design, or product engineering.
• Programming: Strong hands-on programming experience in one or more of C#, Python, or Go.
• Production engineering: Experience with Web APIs, performance/load testing, security, and privacy, with an understanding of building reliable services for production environments.
• Ownership & collaboration: Strong communication and collaboration skills, with the ability to work effectively in a fast-paced, global engineering environment and drive projects from concept to production.

Nice to Have

• Experience building, developing, or operating cloud platforms, particularly Microsoft Azure.
• Hands-on experience with Docker, Kubernetes, and containerized applications.
• Experience with large-scale distributed systems, cloud-native architecture, AI/ML infrastructure, or platform engineering.
• Experience working with or contributing to open-source technologies and communities.
• Experience building highly available, fault-tolerant, self-managing, or self-healing systems.
• Experience with Big Data, AI infrastructure, or large-scale data/compute platforms.
• Fluency in English and/or Chinese.

• #CoreAI
• This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.