Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior LLM Systems Engineer, NeMo Microservices Platform image - Rise Careers
Job details

Senior LLM Systems Engineer, NeMo Microservices Platform - job 2 of 2

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are looking for a Senior LLM Systems Engineer to help build our NeMo Microservice Platform. Our team is building the primitives to let software engineers training and deploying AI at scale. We are dedicated to developing speech and NLP technologies that tackle real problems. We contribute to all steps of the machine learning lifecycle: from conceptualization, to applied research, engineering for optimized inference, and deployment.

What you'll be doing:

  • Development of distributed cloud applications, and microservices and platform able to scale up to huge models

  • Creating microservices for task-specific AI cloud services

  • Implementing core infrastructure for cloud-native AI evaluation

  • Improving service stability, observability and reliability

  • Relentlessly pursue speed of light performance under high load

What we need to see:

  • BS, Masters, or equivalent experience in computer science, computer architecture, or related field

  • 5+ years of experience

  • Ability to work independently, define project goals and scope, interact directly with open source community, and manage your own development effort

  • Experience implementing microservices and cloud-native applications using HTTP REST, gRPC, protobuf, JSON and related technologies

  • Understanding of performance, security and reliability in complex distributed infrastructure

  • Excellent Python programming and software design skills, including debugging, performance and service health analysis, and test design.

Ways to stand out from the crowd:

  • Background with the enterprise software life cycle

  • Experience in deep learning research, particularly model evaluation techniques

  • Experience with Rust or Golang

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning
NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$217750 / YEARLY (est.)
min
max
$148000K
$287500K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

A Senior Software Systems Engineer role at NVIDIA focused on architecting and optimizing autonomous vehicle software for advanced perception and navigation.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

A high-impact role managing automotive developer relationships to accelerate adoption of NVIDIA's AI computing platforms in the autonomous vehicle space.

Photo of the Rise User
SpaceX Hybrid Hawthorne, California, United States
Posted 3 days ago
Mission Driven
Social Impact Driven
Passion for Exploration
Reward & Recognition

Advance SpaceX’s ambitious mission by developing cutting-edge AI software to empower vehicle engineering and space exploration.

Photo of the Rise User

Contribute as a cybersecurity expert at Roche by shaping secure software development and risk management in cutting-edge diagnostic products.

Photo of the Rise User

Senior Staff Software Engineer role at Palo Alto Networks to design and develop innovative cloud identity and security solutions.

Photo of the Rise User
Kemper Hybrid Downers Grove, Illinois
Posted 11 days ago

Kemper is looking for an experienced Senior Full Stack Developer to build robust and scalable customer-facing insurance applications.

osu Hybrid Medical Center Campus
Posted 10 days ago

Lead enterprise application development and support as a Senior Consultant at The Ohio State University's medical center.

Experienced full-stack engineers passionate about AI and product innovation are invited to contribute remotely to an early-stage design marketplace startup backed by Truelogic.

Photo of the Rise User

INflow Federal invites veterans and transitioning military personnel to advance their careers as Full Stack Software Engineers working on cutting-edge defense technology.

Photo of the Rise User
Findem Hybrid San Francisco Bay Area
Posted 12 days ago

Lead backend infrastructure and drive scalable microservices development as a Sr Staff Software Engineer at Findem, a cutting-edge AI/ML HR technology innovator.

Photo of the Rise User
Palo Alto Networks Hybrid Santa Clara, California, United States
Posted 3 hours ago

Palo Alto Networks is looking for an experienced Senior Staff Backend Engineer to design innovative, scalable software solutions with a focus on data engineering and cloud technologies in Santa Clara.

FMR Hybrid Greenwood Village, CO
Posted 5 days ago

Seeking an experienced Senior Software Engineer at Fidelity to build and maintain innovative web applications and services using Agile methodologies and DevOps tools.

Photo of the Rise User
Posted 3 days ago

Experienced Oracle APEX Developer needed to deliver secure, scalable applications for DOJ support under the ESA V program, with a focus on advanced Oracle database and web technology skills.

Photo of the Rise User

Experienced .Net Developer with PeopleSoft and Workday integration expertise wanted for a long-term remote contract opportunity.

Photo of the Rise User
Posted 3 days ago

Drive innovation and software solutions as a Senior Associate Software Engineer at McKesson, a leading Fortune 10 healthcare company.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

492 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
May 19, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!