Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Machine Learning Engineer - Perception Semantics image - Rise Careers
Job details

Machine Learning Engineer - Perception Semantics

The Perception team at Zoox is fundamental to our autonomous vehicle technology, creating the understanding of the world for our self-driving robots. We enable safe and efficient navigation in complex environments through sophisticated detection, classification, and tracking systems.

As an engineer in the Semantics and Foundation Model team, you will develop advanced multimodal large language models that enhance our vehicles' environmental understanding. You'll develop and fine-tune these models for off-vehicle analysis while also optimizing them for real-time performance on our robotaxi platform, ensuring they can efficiently identify hazards and interpret driving restrictions with minimal latency. Working alongside world-class engineers and researchers, you'll leverage premium sensor data and cutting-edge infrastructure to validate your algorithms in real-world conditions, directly impacting the safety and capability of Zoox's autonomous system.


In this role, you will:
  • Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
  • Design and implement efficient model architectures, balancing performance and computational constraints through fine-tuning and distillation techniques
  • Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
  • Collaborate with perception, planning, and systems teams to integrate your models into the vehicle's decision-making pipeline
  • Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system


Qualifications
  • MS or PhD in Computer Science, Machine Learning, or related technical field
  • Demonstrated experience training and deploying perception and computer vision based models
  • Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluationProficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
  • Experience with model optimization techniques such as quantization, pruning, or knowledge distillation


Bonus Qualifications
  • Proficiency in C++
  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with autonomous robotics systems


$160,000 - $245,000 a year

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.


Follow us on LinkedIn


Accommodations

If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.


A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

Average salary estimate

$202500 / YEARLY (est.)
min
max
$160000K
$245000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User

Lead the development and execution of cutting-edge verification and validation methodologies for autonomous vehicle perception systems at Zoox.

Photo of the Rise User

Experienced Embedded Software Engineer wanted at Zoox to develop robust embedded software for autonomous vehicle platforms.

Photo of the Rise User
Posted 6 days ago

Shape and lead the development of Range's premier iOS financial app as a hands-on engineer and platform steward in a fast-growing startup.

Photo of the Rise User
Posted 5 days ago

Experienced Sr. Web Programmer wanted at OCT Consulting to develop and maintain advanced web-based systems supporting weather forecasting at the NWS Pacific Region.

Photo of the Rise User

A leading global payments company is seeking a seasoned Senior Machine Learning Engineer to build and optimize their AI infrastructure with a hybrid work setup in Austin, TX.

Photo of the Rise User
QODE Hybrid No location specified
Posted 13 days ago

Experienced Java Backend Developer wanted to lead scalable backend solutions in a dynamic, innovative environment.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA is seeking a Senior Software Engineer with expertise in bare metal automation to help scale AI infrastructure for GPU computing clusters.

Photo of the Rise User
Trinetix Hybrid No location specified
Posted 12 days ago

An exciting opportunity to contribute as a .NET Developer at TRINETIX, driving advanced software architecture solutions in a dynamic, global tech company.

Photo of the Rise User

Angel Studios is seeking a Senior Software Engineer specialized in Roku development to craft exceptional user experiences on their media platform.

Photo of the Rise User
Posted 14 days ago

A leading retailer is looking for a proactive Software Engineer specializing in .NET and SQL to drive innovative and scalable technology solutions remotely.

Posted 12 days ago

Seeking a Senior Front-End Engineer at Istari Digital to build high-quality, user-focused frontend features in a collaborative, remote-first environment.

Photo of the Rise User
Posted 13 days ago
Inclusive & Diverse
Transparent & Candid
Growth & Learning
Diversity of Opinions
Mission Driven
Customer-Centric
Rapid Growth
Dare to be Different
Collaboration over Competition

Patreon seeks a Backend Engineer to enhance and scale its hybrid payment platform, enabling creators to get paid on time while working collaboratively with cross-functional teams.

Photo of the Rise User
Posted 12 days ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Lead and mentor a world-class AI infrastructure team at NVIDIA, driving innovation in large-scale distributed systems and LLM-based solutions.

Contribute as a hands-on Full-Stack Engineer at Callidus, an advanced legal AI startup, building scalable AI workflows and customer-facing features in San Francisco.

Photo of the Rise User
Atlassian Hybrid Austin, Texas, United States
Posted 5 hours ago
Customer-Centric
Empathetic
Collaboration over Competition
Feedback Forward
Inclusive & Diverse
Mission Driven
Diversity of Opinions
Rise from Within
Medical Insurance
Paid Time-Off
Dental Insurance
Vision Insurance
Maternity Leave
Mental Health Resources
Equity
401K Matching
Employee Resource Groups
Performance Bonus
Education Stipend
Life insurance

Innovate as a Senior Machine Learning Engineer at Atlassian, driving AI integration across products in a flexible hybrid work environment.

Zoox was founded to make personal transportation safer, cleaner, and more enjoyable—for everyone. To achieve that goal, the team created a whole new form of transportation. Zoox will provide mobility-as-a-service in dense urban environments.

239 jobs
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
May 23, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!