Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Principal AI Infrastructure SRE Engineer image - Rise Careers
Job details

Principal AI Infrastructure SRE Engineer - job 1 of 2

NVIDIA has been reinventing computer graphics, PC gaming, and accelerated computing for 30 years. It is a unique legacy of innovation that’s fueled by great technology and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, generative AI, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

Our company is at the forefront of technological innovation, and we are dedicated to driving efficiency and optimizing the performance of our infrastructure both on-prem and cloud. Join us in this exciting endeavor!

We are seeking a highly skilled Principal Infrastructure Engineer to join our dynamic team to build the next generation of IT computing environment, and help lead the team through a major technology transformation into running AI on-prem and build infrastructure by integrating Enterprise ready platforms while building a solid foundation with automation.

What you will be doing:

  • Lead initiatives to transform IT Infrastructure platform architecture and services On-Prem for modern AI workloads and AI semi conductor and software development.

  • Collaborate with partners to design architecture, Build & Operate platforms that transform Storage, Compute & Middleware with modern security paradigms.

  • Build software and automation to run infrastructure at scale with minimal human intervention. Develop and maintain tools for collecting, analyzing, and visualizing data for reporting, alerting, monitoring.

  • Collect and review system data for capacity and planning purposes, analyze capacity data and develop plans for appropriate level enterprise-wide systems, and coordinate with management personnel in implementing changes.

  • Collaborate with NVIDIA leadership, senior engineers, program managers, and product managers to develop compelling IT products and services that meet customer needs.

What we need to see:

  • Bachelor’s degree in Engineering, Computer Science, Mathematics, or related field, or equivalent experience.

  • 15+ years of proven experience in compute platform engineering with a focus on automation.

  • Experience with design, deployment and operation of infrastructure that supports AI and SW development at scale including Kubernetes, integrating modern AI Data infrastructure platforms into Kubernetes workloads.

  • Proven experience integrating existing application architectures and build new identify opportunities for containerization to improve scalability, reliability, and efficiency.

  • Proficiency in programming languages such as Go and/or Python. Experience in developing tools for data analysis and performance profiling, Development with Terraform, Config Management tools.

  • Experience with designing and running large environments consisting of BareMetal servers/virtualized environments with a mix of tens of thousands of VMs and cloud infrastructure or AI infrastructure.

  • Deep understanding of other infrastructure components like Storage, DNS, AD, Security Tools etc..

Ways to stand out from the crowd:

  • Solid understanding of microservices architecture, infrastructure as code (IaC) and configuration management tools.

  • Understanding of AI ops and how to leverage LLMs to automate various optimization initiatives

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid

The base salary range is 248,000 USD - 391,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$319500 / YEARLY (est.)
min
max
$248000K
$391000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 13 days ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Work as a Backend Compiler Engineer at NVIDIA, developing high-performance GPU compiler backends to drive next-generation AI and graphics computing.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Steer NVIDIA's Data Science and Data Engineering products as Vice President of Engineering, leading advanced software initiatives that bridge AI and traditional data processing.

Photo of the Rise User
Adcetera Hybrid No location specified
Posted 8 days ago

Experienced Senior Web Developer needed to craft polished, scalable web solutions using Drupal, WordPress, and modern front-end technologies for a leading digital agency.

Posted 14 days ago

Lead complex civil engineering projects in wastewater as a Senior Civil Project Manager with Hoyle Tanner in Chelmsford, MA.

Photo of the Rise User

Experienced HMI/SCADA Engineer needed to lead development, commissioning, and support of integrated industrial automation systems in a remote work setting.

Photo of the Rise User
Social Impact Driven
Empathetic
Collaboration over Competition
Growth & Learning

Contribute to innovative autonomous vehicle safety by leading verification and validation testing of low and high voltage, telematics, and network systems at Waymo.

Photo of the Rise User
Posted 11 days ago

Lead transportation infrastructure projects as a Proposals Technical Leader at AECOM, shaping innovative and impactful transit and rail designs.

Photo of the Rise User

Lead system-level test strategies for next-generation satellite communication systems at E-Space in Saratoga, CA.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Drive cutting-edge hardware performance and power engineering as Director at NVIDIA, leading strategic initiatives across diverse product lines.

Photo of the Rise User
RETTEW Hybrid Allentown, Pennsylvania, United States
Posted 12 days ago

A Civil Engineer I with strong technical and communication skills is needed at RETTEW to support land development projects, including stormwater design and permitting.

Photo of the Rise User
Medtronic Hybrid Brooklyn Center, Minnesota, United States of America
Posted 13 days ago

Medtronic seeks a Weld Engineer II to enhance welding processes and manufacturing efficiencies in their cardiac device production.

Photo of the Rise User
Broadcom Hybrid USA-California- San Jose - 1730 Fox Drive
Posted 3 days ago

Experienced RF IC Technology Development Engineer needed at Broadcom to lead semiconductor device and MMIC development projects within a global team.

Photo of the Rise User
Foth Hybrid No location specified
Posted 14 days ago

Lead diverse municipal wastewater treatment projects and mentor engineering teams with Foth, a leading member-owned consulting firm.

Photo of the Rise User
Posted 13 days ago

Lead and innovate in device and process technology as Director of Process Technology at Renesas Electronics, driving key semiconductor development initiatives.

Photo of the Rise User
NVIDIA Hybrid US, CA, Santa Clara
Posted 11 days ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA is looking for an experienced ASIC Power Architect to innovate and optimize power solutions for next-generation SoCs in a collaborative and dynamic environment.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

493 jobs
MATCH
VIEW MATCH
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
May 9, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!