Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Staff Software Engineer, Spark Data Processing image - Rise Careers
Job details

Staff Software Engineer, Spark Data Processing

We're Cruise, a self-driving service designed for the cities we love.

We're building the world's most advanced self-driving vehicles to safely connect people to the places, things, and experiences they care about. We believe self-driving vehicles will help save lives, reshape cities, give back time in transit, and restore freedom of movement for many.

In our cars, you're free to be yourself. It's the same here at Cruise. We're creating a culture that values the experiences and contributions of all of the unique individuals who collectively make up Cruise, so that every employee can do their best work.

Cruise is committed to building a diverse, equitable, and inclusive environment, both in our workplace and in our products. If you are looking to play a part in making a positive impact in the world by advancing the revolutionary work of self-driving cars, come join us. Even if you might not meet every requirement, we strongly encourage you to apply. You might just be the right candidate for us.

We're Cruise, a self-driving service designed for the cities we love.

We're building the world's most advanced self-driving vehicles to safely connect people to the places, things, and experiences they care about. We believe self-driving vehicles will help save lives, reshape cities, give back time in transit, and restore freedom of movement for many.

In our cars, you're free to be yourself. It's the same here at Cruise. We're creating a culture that values the experiences and contributions of all of the unique individuals who collectively make up Cruise, so that every employee can do their best work.

At Cruise, the Machine Learning Infrastructure organization (MLI) builds the essential tools, frameworks, and services used by every engineer at Cruise. MLI's goal is to greatly accelerate the development cycle of AV engineers by building the infrastructure to process, analyze, and learn from the many petabytes of data coming from our AVs, simulated tests, and real time services, empowering engineers to focus on improving the car's safety and performance.

About the role:

As an engineer on this team, you will be responsible for building and supporting a petabyte-scale data platform in the cloud and providing powerful foundations for MLI's tools, frameworks, and services. Responsibilities include ensuring scalable, transparent, and reliable data ingestion and management; development of fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company; and development of orchestration for large-scale post-processing, and computational pipelines.

What you'll be doing:

  • Lead us in the development, optimization and productionization of the next generation data processing platform using Spark on cloud.
  • Build self-serve capabilities to help customers to adopt the next generation data processing platform
  • Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes
  • Own technical projects from start to finish, contribute to the team's product roadmap, and be responsible for major technical decisions and tradeoffs. Effectively participate in team's planning, code reviews and design discussions
  • Consider the effects of projects across multiple teams and proactively manage conflicts. Work together with partner teams and orgs to achieve cross-departmental goals and satisfy broad requirements
  • Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities. Effectively onboard and mentor junior engineers and/or interns

What you must have:

  • Experience building a data processing system using Spark and its ecosystems from the ground up
  • Experience optimizing those spark clusters for cost efficiency and performance
  • Experience building scalable infrastructure on the cloud with Python or Java (or similar)
  • 10+ years working with big data
  • BS, MS or Ph.D. in Computer Science, Electrical Engineering, Mathematics, Physics, or another relevant field; or equivalent real-world experience
  • Passionate about self-driving technology and its potential impact on the world
  • Attention to detail and a passion for truth
  • A track record of efficiently solving complex problems
  • Startup mentality - openness to dealing with unknown unknowns and wearing many hats

Bonus points!

  • Demonstrable expertise in a major database product
  • Proficiency in writing SQL queries for analytic purposes
  • Experience in PySpark
  • Relevant publications

The salary range for this position is $193,900 - $285,000. Compensation will vary depending on location, job-related knowledge, skills and experience. You may also be offered a bonus, restricted stock units, and benefits. These ranges are subject to change.

Why Cruise?

  • Our benefits are here to support the whole you:

    • Competitive salary and benefits
    • 401(k) Cruise matching program
    • Medical / dental / vision, AD+D and Life
    • Subsidized mental health benefits
    • Flexible vacation and company paid holidays
    • Healthy meals and snacks available for non-remote employees
    • Paid parental, jury duty, bereavement, family care, and medical leave
    • Fertility Benefits
    • Dependent Care Flexible Spending Account
    • Flexible Spending Account
    • Pre-tax Commuter Benefit Plan for non-remote employees
    • CruiseFlex, a working policy for US-Based Cruisers, lets you and your manager find the working style that's best for you, whether it's primarily in-person, primarily at home, or a combination of home and in-office time. - learn more about CruiseFlex here
  • We're Integrated

    • Through our partnerships with General Motors and Honda, we are the only self-driving company with fully integrated manufacturing at scale.

  • We're Funded

    • GM, Honda, Microsoft, T. Rowe Price, and Walmart have invested billions in Cruise. Their backing for our technology demonstrates their confidence in our progress, team, and vision and makes us one of the leading autonomous vehicle organizations in the industry. Our deep resources greatly accelerate our operating speed.
  • We're Independent

    • We have our own governance, board of directors, equity, and investors. Our independence allows us to not just work on the edge of technology, but also define it.
  • We're Vested

    • You won't just own your work here, you'll have the potential to own equity in Cruise, too. We are competing in a market that is projected to grow exponentially, which gives our company valuation room to grow. We offer a new kind of equity program called Recurring Liquidity Opportunity (RLO), which combines IPO-like liquidity with the stability of remaining private - learn more about RLO here
  • We're Safety Conscious

    • We integrate #staysafe, our top priority at Cruise, into our everyday work. Through our Safety Management System, every Cruiser is asked to do their part by reporting any potential issues or hazards they observe and making continuous improvements. You'll be able to contribute to safety at Cruise, no matter your job function or title.

Cruise LLC is an equal opportunity employer. We strive to create a supportive and inclusive workplace where contributions are valued and celebrated, and our employees thrive by being themselves and are inspired to do the best work of their lives. We seek applicants of all backgrounds and identities, across race, color, caste, ethnicity, national origin or ancestry, citizenship, religion, sex, sexual orientation, gender identity or expression, veteran status, marital status, pregnancy or parental status, or disability. Applicants will not be discriminated against based on these or other protected categories or social identities. Cruise will consider for employment qualified applicants with arrest and conviction records, in accordance with applicable laws.

Cruise is committed to the full inclusion of all applicants. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know or email HR@getcruise.com.

We proactively work to design hiring processes that promote equity and inclusion while mitigating bias. To help us track the effectiveness and inclusivity of our recruiting efforts, please consider answering the following demographic questions. Answering these questions is entirely voluntary. Your answers to these questions will not be shared with the hiring decision makers and will not impact the hiring decision in any way. Instead, Cruise will use this information not only to comply with any government reporting obligations but also to track our progress toward meeting our diversity, equity, inclusion, and belonging objectives.

Candidates applying for roles that operate and remotely operate the AV: Licensed to drive a motor vehicle in the U.S. for the three years immediately preceding your application, currently holding an active in-state regular driver's license or equivalent, and no more than one point on driving record. A successful completion of a background check, drug screen and DMV Motor Vehicle Record check is also required.

Note to Recruitment Agencies: Cruise does not accept unsolicited agency resumes. Furthermore, Cruise does not pay placement fees for candidates submitted by any agency other than its approved partners.

While our driverless cars help make streets safer, they also make people feel safer—safer to ride at any time, safer to ride to any neighborhood, safer to ride exactly as they are.

84 jobs
FUNDING
TEAM SIZE
DATE POSTED
July 21, 2023

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
Other jobs
Company
Posted last year
Company
Unilever Hybrid Englewood Cliffs, NJ
Posted last year
Company
Posted last month