Principal Software Engineer

Job number 200065303. Date posted Nov 03, 2026. Work site: 0 days / week in-office – remote. Travel: Less than 25%. Overview The Azure Core team, within Azure’s Compute & AI organization, is responsible for building and operating the infrastructure services that support the training, deployment, and evaluation of frontier AI models at Microsoft. These services underpin the training pipelines for the next generation of AI models, driving innovation in AI and machine learning at scale. We are looking for a Principal Software Engineer to join the Azure Core team and help define the future of AI infrastructure at Microsoft. In this role, you will lead the design and development of distributed systems that enable efficient, reliable, and scalable model training, evaluation, and data processing for the world’s most advanced AI workloads. You will work closely with researchers, data scientists, and engineers across Microsoft to build systems that directly support the development of next-generation AI models and improve the quality of our AI-powered products. Our team is at the forefront of building the infrastructure that powers AI innovation. We are developing the systems and tools that allow AI researchers and engineers to iterate faster, evaluate models more effectively, and deploy AI solutions at scale. As a Principal Software Engineer, you will be a key contributor to this mission, driving technical direction, mentoring engineers, and shaping the architecture of our AI infrastructure services. If you are passionate about AI, distributed systems, and building infrastructure at scale, and you want to work on the cutting edge of AI technology, we encourage you to apply. Join us in shaping the future of AI at Microsoft and help us build the systems that will power the next generation of intelligent applications. At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. We are committed to creating an inclusive environment where diverse perspectives are valued and everyone can contribute to their full potential. We believe that the best products and services come from teams that reflect the diversity of the world we serve. Responsibilities Lead the design and architecture of complex, distributed systems that support AI model training, evaluation, and data processing at scale. Drive technical direction for the team, setting the vision for AI infrastructure and ensuring alignment with broader organizational goals. Collaborate with cross-functional teams, including researchers, data scientists, and engineers, to define requirements and deliver high-quality solutions. Build and maintain scalable, reliable, and efficient systems that enable the training and evaluation of frontier AI models. Mentor and guide engineers, fostering a culture of technical excellence, innovation, and continuous learning. Ensure the quality and reliability of our systems through rigorous testing, code reviews, and best practices in software engineering. Qualifications Required Qualifications: Bachelor’s Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Experience designing, building, and operating large-scale distributed systems. Strong understanding of distributed systems, cloud computing, and AI/ML infrastructure. Experience with AI/ML frameworks and tools, such as PyTorch, TensorFlow, or similar. Excellent communication and collaboration skills, with the ability to work effectively across teams and organizations. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred Qualifications: Master’s Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Experience with large-scale AI model training and evaluation, including familiarity with distributed training techniques and optimization strategies. Experience with Kubernetes, Docker, or other containerization and orchestration technologies. Familiarity with Azure services and infrastructure, particularly in the context of AI and machine learning workloads. Software Engineering IC5 – The typical base pay range for this role across Canada is CAD $142,400 – CAD $257,500 per year. Find additional pay information here: https://careers.microsoft.com/v2/global/en/us-corporate-pay.html This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.