Senior Software Developer, AI Networking

NVIDIA is changing the world of AI Networking with groundbreaking technology. We are excited to be adding an AI Networking Software Developer to our AI Networking SW development and codesign team. We are working with the latest NVIDIA hardware and technologies. We do full stack benchmarking for Data Center scale systems for AI training/inference and lower level benchmarks. We strive for automation and develop many tools in-house yet adopt community accepted practices and frameworks. Moreover we give back to community developing our own tools in public GitHub repositories. Our goal is to ensure that large-scale systems deliver expected performance in practice, not just on paper, by uncovering bottlenecks and driving continuous improvements.

What You'll Be Doing

• Developing AI networking communication frameworks and applications running in production on the world’s largest supercomputers and data centers.
• Develop production tools and benchmarks used by multiple teams inside and outside NVIDIA.
• Enable new AI models within our benchmarking infrastructure and deliver insights through end-to-end analysis of large-scale workloads across hardware and software stacks.
• Design and implement automation systems, including large-scale parameter search to identify optimal configurations across complex systems.
• Collaborate closely with networking and hardware teams to co-design new features and software interfaces in a fast-paced, evolving environment.

What We Need To See

• B.Sc., M.Sc degree in Computer Science / Software engineering, and 5+ years or equivalent experience.
• Professional Python development experience. We seek individuals who build maintainable, long-lived tools that do not impose a heavy burden on the team in terms of maintenance.
• Solid Linux expertise and passion for working extensively in command-line environments.
• Ability to work across a broad and evolving stack, with a strong drive to learn—from hardware and networking up to large-scale AI systems running across entire clusters

Ways To Stand Out From The Crowd

• Knowledge and/or experience with modern AI ecosystem: PyTorch, LLMs, inference and training.
• Familiarity with cluster orchestration systems such as Slurm or Kubernetes.
• Knowledge in MPI and HPC, InfiniBand, Ethernet and Networking.
• Experience in performance optimizations

For two decades, we have pioneered visual computing, and the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, product design, medical diagnosis and scientific research. Today, we stand at the beginning of the next era, the AI computing era, ignited by a new computing model, GPU deep learning. This new model - where deep neural networks are trained to recognize patterns from massive amounts of data - has shown to be deeply effective at solving some of the most complex problems in everyday life. NVIDIA is widely considered to be one of the technology world's most desirable companies to work for. Are you creative and driven? Do you love a challenge? If so, we want to hear from you.

, , JR2016186