Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior LLM Systems Engineer, NeMo Microservices Platform image - Rise Careers
Job details

Senior LLM Systems Engineer, NeMo Microservices Platform - job 1 of 2

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are looking for a Senior LLM Systems Engineer to help build our NeMo Microservice Platform. Our team is building the primitives to let software engineers training and deploying AI at scale. We are dedicated to developing speech and NLP technologies that tackle real problems. We contribute to all steps of the machine learning lifecycle: from conceptualization, to applied research, engineering for optimized inference, and deployment.

What you'll be doing:

  • Development of distributed cloud applications, and microservices and platform able to scale up to huge models

  • Creating microservices for task-specific AI cloud services

  • Implementing core infrastructure for cloud-native AI evaluation

  • Improving service stability, observability and reliability

  • Relentlessly pursue speed of light performance under high load

What we need to see:

  • BS, Masters, or equivalent experience in computer science, computer architecture, or related field

  • 5+ years of experience

  • Ability to work independently, define project goals and scope, interact directly with open source community, and manage your own development effort

  • Experience implementing microservices and cloud-native applications using HTTP REST, gRPC, protobuf, JSON and related technologies

  • Understanding of performance, security and reliability in complex distributed infrastructure

  • Excellent Python programming and software design skills, including debugging, performance and service health analysis, and test design.

Ways to stand out from the crowd:

  • Background with the enterprise software life cycle

  • Experience in deep learning research, particularly model evaluation techniques

  • Experience with Rust or Golang

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning
NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$217750 / YEARLY (est.)
min
max
$148000K
$287500K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA is looking for a Senior Technical Marketing Engineer to drive adoption of CUDA-Q in academia by engineering educational platforms and integrating GPUs and QPUs into curriculum.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

A Senior Software Systems Engineer role at NVIDIA focused on architecting and optimizing autonomous vehicle software for advanced perception and navigation.

Photo of the Rise User

Walter P Moore seeks a motivated Senior Structural Engineer with extensive experience in commercial structures to join their Dallas team.

Photo of the Rise User
Posted 2 days ago

Dewberry’s Orlando office invites entry-level Civil Engineers to join their Traffic Engineering team, performing traffic studies and signal design on complex projects.

Photo of the Rise User
Posted 7 days ago

Advex is seeking an experienced Head of Engineering to lead its team and shape the future of vision AI in manufacturing at their seed-stage startup.

Photo of the Rise User
Church & Dwight Hybrid USA, Old Fort, OH
Posted 4 days ago

Seeking a skilled Process Engineer to lead process improvements and capital projects at a dynamic manufacturing facility specializing in consumer products.

Posted 2 days ago

Experienced Sr. Wireless Engineer needed at NFF to lead advanced Cisco wireless network design, implementation, and security in challenging environments.

Coffman Engineers, Inc. Hybrid 901 South MoPac Expressway, Barton Oaks Plaza Four #343, Austin, TX, United States
Posted 5 days ago

Coffman Engineers seeks an experienced Senior Mechanical Designer to deliver advanced mechanical design expertise in their Austin office.

Parsons Hybrid US - VA, Centreville
Posted 11 days ago

Parsons invites skilled DevOps Engineers with active Top Secret clearances to join their federal solutions team, driving innovation and automation in complex software deployment environments.

Posted 13 days ago

Experienced Wastewater Process Engineer needed to design and optimize wastewater treatment systems at Hoyle Tanner in Burlington, VT.

Photo of the Rise User
REE Medical Hybrid No location specified
Posted 11 days ago

Lead and mentor an engineering team managing Microsoft Azure and SQL data environments to drive scalable and secure data solutions at REE Medical.

Posted 7 days ago

Experienced Electrical Design Engineer wanted to join a stable manufacturing company focused on innovative structural systems in biotech and pharma sectors.

ngc Hybrid United States-California-San Diego
Posted 11 days ago

Northrop Grumman invites an experienced Systems Safety Engineer to lead safety analysis and verification on advanced aeronautical and military systems in San Diego, CA.

Photo of the Rise User
Valsoft Corporation Hybrid No location specified
Posted 5 days ago

Lead Sadie's engineering teams as Development Manager to deliver innovative AI-powered voice solutions for the restaurant industry.

Photo of the Rise User
Posted 2 days ago

BE Power Equipment is looking for a detail-oriented CAD Draftsperson proficient in AutoCAD and SolidWorks to create and update technical drawings supporting manufacturing operations.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

493 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
May 23, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!