Software Engineer Intern

Our work at NVIDIA is dedicated towards a computing model focused on visual and AI computing. For two decades, NVIDIA has pioneered visual computing, the art and science of computer graphics, with our invention of the GPU. The GPU has also shown to be spectacularly effective at solving some of the most complex problems in computer science. Today, NVIDIA’s GPU simulates human intelligence, running deep learning algorithms and acting as the brain of computers, robots and self-driving cars that can perceive and understand the world. We are looking to grow our company and teams with the smartest people in the world and there has never been a more exciting time to join our team!The PyTorch Team at NVIDIA is hiring passionate parallel programmers. Join us to design and build the tools used by millions of AI practitioners deploying AI applications scalable to thousands of GPUs. Our team is responsible for the continual delivery of best in class experience on NVIDIA's hardware with PyTorch. In this position you will learn innovative techniques from NVIDIA's domain experts for efficiently programming the world's most sophisticated computers. Build these techniques into NVIDIA/Fuser (commonly known as "nvFuser") applying our groundbreaking Parallel Programming Theory, allowing these optimization techniques to be applied to algorithms broadly, automatically, and safely to algorithms written in Numpy and PyTorch. Beyond building nvFuser influence and improve the entire software stack all the way from users to the CUDA compiler, as well as influence the future design of NVIDIA's hardware platform.What you will be doing:• Partnering with NVIDIA’s hardware and software teams to improve GPU performance in PyTorch.• Design, build and support production AI solutions used by enterprise customers and partners.• Optimize the performance of influential, modern Deep Learning models coming out of academic and industry research, for NVIDIA GPUs and systems.• Collaborating with internal applied researchers to improve their AI tools.• Advise design of new hardware generations.What we need to see:• Pursuing a BS, MS, or PhD Computer Science, Computer Engineering, Electrical Engineering or a related field.• Experience with C++ and Python programming.• We require excellent verbal and written communication skills.Ways to stand out from the crowd:• Experience developing large software projects.• A technical foundation in CPU and GPU architectures, numeric libraries, modular software design.• Experience with machine learning frameworks (e.g. PyTorch, TensorFlow, scikit-learn, etc.)• Experience working with and optimizing Large Language Models or conversational systems.• Experience with building core PyTorch components to maximize network performance and utilization.• Experience with deep learning compilers and contributions to PyTorch, Numpy, JAX, TensorFlow, OpenAI-Triton, TVM, Halide or similar system.​NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!The hourly rate for our interns is 16 USD - 88 USD. Our internship hourly rates are a standard pay determined based on the position and your location, year in school, degree, and experience.You will also be eligible for Intern benefits. NVIDIA accepts applications on an ongoing basis. ​NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.