Software Engineer II

Overview

The HPC/AI (High performance Computing and Artificial Intelligence) team is on a mission to build the next-generation distributed AI supercomputer, enabling breakthroughs in artificial intelligence by delivering unmatched computational power, scalability and reliability. We design and develop cutting-edge infrastructure that supports high-performance AI model training at scale, laying the foundation for innovations that redefine what AI can achieve.

We are seeking passionate and innovative software engineers to design and build cutting-edge networking infrastructure that powers large-scale AI training. This role focuses on developing next-generation networking capabilities to ensure high performance, low latency, and minimal jitter for distributed AI workloads. You will play a critical role in enabling state-of-the-art AI systems to achieve their full potential.

As a Software Engineer II on the HPC/AI team, you will play a pivotal role in shaping the next-generation networking infrastructure for AI training and inference in Azure Cloud. This is a unique opportunity to work at the intersection of two of the hottest fields in technology: AI and high-performance computing. With the explosive growth of generative AI and the increasing demand for large-scale, low-latency systems, this area is at the forefront of innovation and impact. You will work across diverse network architectures and cutting-edge processor and accelerator technologies, driving the design and delivery of a comprehensive, end-to-end solution with a relentless focus on performance, scalability, and observability.

If you’re passionate about groundbreaking technology, large-scale systems, and AI infrastructure, join us to build the platform that will power the future of AI supercomputing!

Responsibilities

• Design, develop, and optimize networking solutions tailored for large-scale AI training infrastructure.
• Architect and implement high-performance, low-latency, and low-jitter communication frameworks for distributed systems.
• Benchmark, analyze, and enhance the scalability and reliability of networking systems to handle petabyte-scale data transfer.
• Debug and resolve complex networking issues in large-scale, high-performance environments.
• Drive identification of dependencies and the development of design documents for a product, application, service, or platform.
• Create, implement, optimize, debug, refactor, and reuse code to establish and improve performance and maintainability, effectiveness, and return on investment (ROI).
• Act as a Designated Responsible Individual (DRI) and guide other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions.
• Proactively seek new knowledge and adapt to new AI trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.