Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Solutions Architect, Generative AI Inference and Deployment image - Rise Careers
Job details

Solutions Architect, Generative AI Inference and Deployment

NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. We're looking to grow our company, and build our teams with the smartest people in the world. Would you like to join us at the forefront of technological advancement? You will become a trusted technical advisor with our customers and work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with a diverse set of internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative AI, LLMs and GPU technologies. This role is an excellent opportunity to work in an interdisciplinary team at NVIDIA!

What You Will Be Doing:

  • Partnering with other solution architects, engineering, product and business teams. Understanding their strategies and technical needs and helping define high-value solutions

  • Dynamically engaging with developers, scientific researchers, and data scientists, gaining experience across a range of technical areas

  • Strategically partnering with lighthouse customers and industry-specific solution partners targeting our computing platform

  • Working closely with customers to help them adopt and build creative solutions using NVIDIA technology and MLOps solutions

  • Analyzing performance and power efficiency of AI inference workloads on Kubernetes

  • Some travel to conferences and customers may be required

What We Need To See:

  • BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience)

  • 5+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow

  • Strong fundamentals in programming, optimizations, and software design, especially in Python

  • Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) management within Kubernetes environments

  • Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments

  • Strong knowledge of the theory and practice of LLM and DL inference

  • Excellent presentation, communication and collaboration skills

Ways To Stand Out From The Crowd:

  • Prior experience with DL training at scale, deploying or optimizing DL inference in production

  • Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, Dynamo, TensorRT, TensorRT-LLM

  • Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design

  • Familiarity with parallel programming and distributed computing platforms

The base salary range is 148,000 USD - 235,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$191875 / YEARLY (est.)
min
max
$148000K
$235750K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 11 days ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Experienced Senior Account Manager needed to lead NVIDIA’s growth and technology adoption efforts within the USAF and USSF, leveraging deep defense sector expertise.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Lead NVIDIA’s Data Center Quality efforts as a Senior Program Manager, driving customer satisfaction and operational excellence across enterprise partners.

Photo of the Rise User
Posted 11 days ago

Electrical Engineering graduates are invited to contribute at Kimley-Horn’s Virginia Beach office by supporting innovative projects and technical solutions in a hands-on, onsite role.

Photo of the Rise User
Wood Hybrid Houston, Texas, United States
Posted 4 days ago

Lead the Field Engineering & Troubleshooting team at BMA Solutions Inc., supporting diverse field projects across the U.S. with a fully remote role and significant travel.

Delve Underground Hybrid Burlington, Massachusetts, United States
Posted 3 days ago

Delve Underground invites experienced engineers to lead water/wastewater tunnel projects and business development efforts in Massachusetts as a Lead Associate.

Photo of the Rise User

Contribute to advancing healthcare AI by building and scaling core ML infrastructure at Ambience, a well-funded AI healthcare startup based in San Francisco.

Seeking a detail-oriented Supplier Quality Engineer to drive quality improvements in vendor materials essential to national defense manufacturing.

Photo of the Rise User
Umbra Hybrid Santa Barbara, California, United States
Posted 5 days ago

Join Umbra’s multidisciplinary engineering team as a Senior Spacecraft Mechanical Engineer to develop cutting-edge spacecraft hardware and mechanisms.

Photo of the Rise User
Posted 14 days ago

Lead and mentor engineering teams in delivering innovative water treatment and distribution projects at a leading global infrastructure firm.

Photo of the Rise User

A Senior Solution Architect role at Palo Alto Networks to lead strategic security solutions and partnerships with NTT, enhancing customer adoption of cutting-edge cybersecurity technology.

Lead operational communications and project management at Hadrian, a cutting-edge company pioneering autonomous aerospace manufacturing.

Photo of the Rise User
Wood Hybrid Metairie, Louisiana, United States
Posted 13 days ago

An experienced Lead I&E Engineer is needed to manage offshore brownfield instrumentation and electrical engineering efforts in Wood's Metairie office.

Photo of the Rise User
Posted 6 days ago
Customer-Centric
Inclusive & Diverse
Empathetic
Collaboration over Competition
Fast-Paced
Growth & Learning
Transparent & Candid

Drive innovation and technical leadership at Stripe as a Senior Staff Engineer in our Core Infrastructure team, building resilient, scalable cloud systems.

Posted 8 days ago

Chemical engineering interns at Chevron engage in hands-on projects to enhance facility operations and prepare for potential full-time roles within a leading energy company.

ngc Hybrid United States-Maryland-Baltimore
Posted 13 days ago

Lead advanced system architecture and standards development initiatives as a Staff Systems Architect at Northrop Grumman’s Linthicum campus.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

492 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
June 27, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!