Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Senior System Architect, GPU image - Rise Careers
Job details

Senior System Architect, GPU

We are looking for a Senior System Architect for our GPU team!

A key part of NVIDIA's strength is to innovate and deliver the highest performance in the world for AI and accelerated computing. We are constantly looking for ways to improve our GPU architecture and maintain our leadership. NVIDIA is seeking a motivated system architect to define future aspects of our GPU through employing pioneering technologies. Your role will be cross-disciplinary, working with software, ASIC design, verification, physical design, VLSI and platform teams. Our system architects excel at pushing the state of the art while making the best engineering trade-offs.

What you will be doing:

  • Develop GPU architecture innovations and improvements, optimizing along the axes of performance, power efficiency, complexity, area, yield, effort, and schedule.

  • Evaluate and benchmark GPU configurations (core counts, memory bandwidth, interconnect topologies) from employing different advanced packaging technologies, and identifying optimal designs for different future data center workloads.

  • Develop and enhance performance analysis infrastructure, including performance simulators, testbench components and analysis tools, to evaluate configurations under different constraints.

  • Implement and maintain high-level functional and performance models. Analyze application workloads and performance simulation results to identify areas of architecture improvements.

  • Document decisions in system architecture specifications, working with multi-functional teams in the organization including ASIC design, software, and VLSI to review, and explore architecture trade-offs, define overall solutions and track development progress.

  • Collaborate with other functional teams (ASIC, Floorplan Designs, Package Designs and Systems Engineering, etc) to validate packaging choices against performance, cost, and scalability targets.

What we need to see:

  • Master’s/PhD in Computer Engineering, Computer Science or related fields (or equivalent experience)

  • A minimum of 8 years of relevant work experience in GPU or CPU System Architecture development

  • Proficiency in data analysis (Python, Excel) to correlate configuration changes with performance metrics.

  • Deep understanding of accelerated computing and AI data center requirements and tradeoffs, including performance bottlenecks, TCO, Power Delivery Network (PDN), DC Networking, etc

  • Strong communication and interpersonal skills, as well as the ability to thrive in a dynamic, collaborative, distributed team.

Ways to stand out from the crowd:

  • Experience with GPU architecture, especially in off-chip IO, memory subsystem, and/or Network-on-Chip (NoC)/Interconnect. Knowledgeable in system level functions such as reset and boot, DFT, and/or power management

  • Expertise in analyzing performance scaling and bottlenecks at device and system levels for AI/accelerated computing workloads

  • Knowledgeable in advanced packaging technologies, and their costs and benefits

  • Consistent track record of efficiently implementing complex architectural features

  • Exceptional problem-solving skills with a focus on optimizing performance, area, complexity, and power.

The base salary range is 224,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$324750 / YEARLY (est.)
min
max
$224000K
$425500K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Senior System Architect, GPU, NVIDIA

At NVIDIA, we're on the lookout for an exceptional Senior System Architect to join our talented GPU team in beautiful Santa Clara, CA. As part of a company that prides itself on delivering the highest performance in AI and accelerated computing, you will play a pivotal role in shaping the future of our GPU architecture. We're all about innovation, and we believe that great ideas come from collaboration across disciplines. In this position, you’ll not only be optimizing GPU architecture for performance, efficiency, and complexity but also diving into the cutting-edge technologies that keep us ahead in the market. Your responsibilities will include evaluating configurations, developing performance analysis infrastructure, and working closely with teams across ASIC design, software, and VLSI to document your architectural decisions. With your advanced data analysis skills and deep understanding of accelerated computing, you’ll help us tackle future data center workloads and identify areas for improvement, while thriving in a dynamic, collaborative environment. If you’re passionate about GPU architecture and eager to apply your expertise in a team that values innovation as much as you do, NVIDIA is the place for you to bring your outstanding problem-solving skills to the forefront!

Frequently Asked Questions (FAQs) for Senior System Architect, GPU Role at NVIDIA
What are the responsibilities of a Senior System Architect at NVIDIA?

The Senior System Architect at NVIDIA is responsible for developing innovative GPU architecture improvements, optimizing performance and power efficiency, and evaluating GPU configurations for future data center workloads. Additionally, you will be involved in creating performance analysis infrastructure and collaborating with multi-functional teams to document architectural decisions.

Join Rise to see the full answer
What qualifications are needed for the Senior System Architect position at NVIDIA?

To be considered for the Senior System Architect role at NVIDIA, you need a Master's or PhD in Computer Engineering, Computer Science, or a related field. A minimum of 8 years of relevant experience in GPU or CPU System Architecture development is required, along with proficiency in data analysis using tools like Python or Excel.

Join Rise to see the full answer
How can I stand out as a candidate for the Senior System Architect role at NVIDIA?

Candidates can stand out for the Senior System Architect position by showcasing their experience with GPU architecture, especially in off-chip I/O and memory subsystems. Knowledge of advanced packaging technologies and the ability to analyze performance scaling for AI workloads can also set candidates apart.

Join Rise to see the full answer
What skills are essential for success as a Senior System Architect at NVIDIA?

Essential skills for the Senior System Architect role at NVIDIA include strong communication and interpersonal skills, deep knowledge of accelerated computing requirements, and exceptional problem-solving abilities aimed at optimizing complex architectural features.

Join Rise to see the full answer
What is the salary range for a Senior System Architect at NVIDIA?

The base salary for a Senior System Architect at NVIDIA ranges from $224,000 to $425,500. Your exact salary will depend on your location, experience, and comparative pay for similar positions within the company.

Join Rise to see the full answer
Common Interview Questions for Senior System Architect, GPU
Can you explain your experience with GPU architecture?

When answering this question, discuss any specific projects or roles where you worked with GPU architecture, highlighting your responsibilities and contributions to the design and optimization processes.

Join Rise to see the full answer
How do you evaluate and benchmark different GPU configurations?

Explain your approach to benchmarking, including factors you consider such as core counts, memory bandwidth, and interconnect topologies, and share any tools or methodologies you’ve used.

Join Rise to see the full answer
What strategies do you use to optimize GPU performance?

Discuss the techniques you have employed to enhance GPU performance, considering performance, power efficiency, and complexity, and provide examples of challenges faced and solutions implemented.

Join Rise to see the full answer
Describe your experience with performance analysis tools.

Share specific tools or frameworks you have used for performance analysis in GPU architectures, and detail how you utilized these tools to derive insights and drive architectural decisions.

Join Rise to see the full answer
How would you collaborate with ASIC design and VLSI teams?

Talk about your experience working in cross-functional teams, and describe how you successfully communicated architectural trade-offs and guided collaborative decisions with ASIC design and VLSI teams.

Join Rise to see the full answer
Explain a complex architectural feature you implemented.

Provide a real-world example of a complex feature you worked on, detailing the decision-making process, the challenges encountered, and the impact it had on the overall architecture.

Join Rise to see the full answer
What are the key considerations when defining GPU architecture for data centers?

Identify critical aspects such as performance requirements, TCO, power delivery, and bottleneck analysis, and elaborate on how you balance these considerations with business objectives.

Join Rise to see the full answer
How do you approach analyzing performance bottlenecks?

Describe your methodology for identifying performance bottlenecks, including data analysis techniques and any frameworks or tools you utilize to support your findings and recommendations.

Join Rise to see the full answer
Can you discuss your experience with advanced packaging technologies?

Share your knowledge of advanced packaging technologies, discussing any direct experience you've had with them, along with how they relate to cost and performance considerations in GPU architecture.

Join Rise to see the full answer
What do you see as the future trends in GPU architecture?

Reflect on current advancements in technology and discuss where you envision GPU architecture heading in terms of capabilities and applications, particularly in AI and accelerated computing.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
NVIDIA Hybrid US, CA, Santa Clara
Posted 8 days ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA is looking for a creative Marketing Campaign Manager to drive impactful marketing strategies for enterprise and developer products.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA seeks a visionary leader with extensive IAM and cybersecurity expertise to drive identity modernization and enhance security posture.

Photo of the Rise User
Ajna Infotech Remote Raritan, Raritan, New Jersey, United States
Posted 4 days ago

Seeking an experienced GCP Infrastructure Architect with Python expertise to drive cloud architecture initiatives for major enterprise clients.

Photo of the Rise User
Compu Dynamics Hybrid US, Loudoun County, VA; Virginia, Chantilly, Loudoun County, VA
Posted 2 days ago

Join Compu Dynamics as a Traveling Electrical Superintendent to lead mission-critical construction projects across various sites.

Photo of the Rise User

Be part of Northrop Grumman's team as a Staff Engineer Systems, leading innovative projects that support national defense.

Photo of the Rise User
Avery Dennison Hybrid 5430 Lyndon B Johnson Fwy, Dallas, TX 75240, USA
Posted 2 days ago

Avery Dennison is looking for a Solutions Architect to innovate digital and physical connectivity solutions that drive business growth in the apparel industry.

Photo of the Rise User
KION GROUP Hybrid Wauwatosa, WI, United States
Posted 5 days ago

Join Dematic's Global Project Engineering team as a Mechanical Project Engineer and contribute to innovative engineering solutions.

Photo of the Rise User

Join APL as a Maritime Surveillance Systems Engineer/Analyst and make significant contributions to the U.S. Navy's next-generation sonar capabilities.

Photo of the Rise User
Posted 7 days ago

Join ACCIONA as a Roadway Design Engineer and contribute to significant infrastructure projects focused on sustainable development.

Photo of the Rise User
Groq Hybrid Palo Alto, California, United States
Posted 10 days ago

Join Groq in a critical role as a Sr. Staff New Product Introduction Engineer, driving the launch of groundbreaking AI products.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

273 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, on-site
DATE POSTED
April 15, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
Someone from OH, Hamilton just viewed Team Member Travel Coordinator at Allegiant
Photo of the Rise User
Someone from OH, Kent just viewed Senior Director, Program at Teaching Lab
Photo of the Rise User
Someone from OH, Toledo just viewed IT Telecom Administrator at Anduril Industries
Photo of the Rise User
Someone from OH, Kent just viewed Director, Strategic Partnerships at Teaching Lab
G
Someone from OH, Cincinnati just viewed Operations Lead - AML Refresh Ops (Global Banking) at GHR
Photo of the Rise User
Someone from OH, Akron just viewed Data Scientist II at Kaiser Permanente
Photo of the Rise User
Someone from OH, Eastlake just viewed Summer Intern at Gooch & Housego
I
Someone from OH, Perrysburg just viewed CNC Manufacturing Technician at Innovance
Photo of the Rise User
Someone from OH, Cincinnati just viewed Senior Lifecycle Marketing Manager at SoFi
Photo of the Rise User
Someone from OH, Cincinnati just viewed Lifecycle Marketing Manager at Caribou
Photo of the Rise User
Someone from OH, Cincinnati just viewed Senior Marketing Manager at Ocorian
Photo of the Rise User
Someone from OH, Cincinnati just viewed Growth Marketing Manager at Credit Genie
Photo of the Rise User
Someone from OH, Cincinnati just viewed Director of Product Marketing - AAA Campaigns at PrizePicks
Photo of the Rise User
Someone from OH, Cincinnati just viewed Digital Marketing Analyst, Digital Properties at Darden
Photo of the Rise User
Someone from OH, Cincinnati just viewed Growth Lead at io.net
Photo of the Rise User
56 people applied to REMOTE Sr Piping Designer at Kelly