Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Software Engineer, Core Engine image - Rise Careers
Job details

Software Engineer, Core Engine

About Eventual

Eventual is a data platform that helps data scientists and engineers build data applications across ETL, analytics and ML/AI.

OUR PRODUCT IS OPEN-SOURCE AND USED AT ENTERPRISE SCALE

Our distributed data engine Daft is open-sourced and runs on 800k CPU cores daily. This is more compute than Frontier, the world's largest supercomputer!

Daft is used at leading AI/ML companies such as Amazon, TogetherAI, EssentialAI, CloudKitchens and more. It makes ML/AI workloads easy and performant to run alongside traditional relational tabular workloads.

Today's “Big Data” data tooling (Spark, Trino, Snowflake) was built for a world of tabular data analytics. They do not generalize well to the needs of modern ML/AI data workloads. We built Daft to be the successor to these Big Data technologies along these core principles:

Python-native: Python is the native language of ML/AI and most of data engineering today

First-Class Local Development UX: Interactive development in a local Python notebook or script is where the magic happens

Multimodal Data Support: Modern workloads require support for operations on complex types such as long-form text, images, tensors and more

Heterogenous Compute (GPUs): GPUs are a requirement for workloads that perform model batch inference as part of the overall query

Key Responsibilities:

As a Software Engineer on the Core Engine team, you will build key capabilities for the Daft distributed data engine.

You will be working on core architectural design and implementation of various components in Daft including:

Planning/Query Optimizer: intelligently optimize users’ workloads with modern database techniques

Execution Engine: improve memory stability through the use of streaming computation and more efficient data structures

Distributed Scheduler: improve Daft’s resource utilization, task scheduling and fault tolerance

Storage: improve Daft integrations with modern data lake technologies such as Apache Parquet, Apache Iceberg and Delta Lake

Our goal is to build the world’s best open-source distributed query engine, becoming the leading framework for data engineering and analytics.

We are a young startup - so be prepared to wear many hats such as tinkering with infrastructure, talking to customers and participating heavily in the core design process of our product!

What we look for:

We are looking for a candidate with a strong foundation in systems programming and ideally experience with building distributed data systems or databases (e.g. Hadoop, Spark, Dask, Ray, BigQuery, PostgreSQL etc)

Our ideal candidate has:

3+ years of experience working with distributed data systems (query planning, optimizations, workload pipelining, scheduling, networking, fault tolerance etc)

Strong fundamentals in systems programming (e.g. C++, Rust, C) and Linux

Familiarity and experience with cloud technologies (e.g. AWS S3 etc)

Most importantly, we are looking for someone who works well in small, focused teams with fast iterations and lots of autonomy. If you are passionate, intellectually curious and excited to build the next generation of distributed data technologies, we want you on the team!


Benefits and Remote Work

We are believers in both having the flexibility of remote work but also the importance of in-person work, especially at the earliest stages of a startup. We have a flexible hybrid approach to in-person work with at least 3 days of in-person work typically from Monday - Wednesday at our office in San Francisco.

We believe in providing employees with best-in-class compensation and benefits including meal allowances, comprehensive health coverage including medical, dental, vision and more.


About the interview


INTRODUCTORY CALL [15M]

A short phone screen over video call with one of our co-founders for us to get acquainted, understand your aspirations and evaluate if there is a good fit in terms of the type of role you are looking for.

TECHNICAL PHONE SCREEN [1 HR]

A technical phone screen question over video call to understand your technical abilities.

TECHNICAL INTERVIEW PANEL [4 HR]

Technical interviews with the rest of the Eventual team with questions to further understand your technical strengths, weaknesses and experiences.


MEET THE TEAM

As many chats as necessary to get to know us - come have a coffee with our co-founders and existing team members to understand who we are and our goals, motivations and ambitions.

We look forward to meeting you!


WE'RE GROWING - COME GROW WITH US!

We are well funded by investors such as YCombinator, Caffeinated Capital, Array.vc and top angels in the valley from Databricks, Meta and Lyft.

Our team has deep expertise in high performance computing, big data technologies, cloud infrastructure and machine learning. Our team members have previously worked in top technology companies such as Amazon, Databricks, Tesla and Lyft.

We are looking for exceptional individuals with a passion for technology and a strong sense of intellectual curiosity.

If that sounds like you, please reach out even if you don't see a specific role listed that matches your skillsets - we'd love to chat!

Eventual Glassdoor Company Review
4.8 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
Eventual DE&I Review
5.0 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of Eventual
Eventual CEO photo
Unknown name
Approve of CEO

Average salary estimate

$110000 / YEARLY (est.)
min
max
$90000K
$130000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Software Engineer, Core Engine, Eventual

Are you an innovative Software Engineer looking to make a real impact in the world of data technology? Eventual, based in the vibrant city of San Francisco, is on the hunt for a passionate Software Engineer to join our Core Engine team. At Eventual, we're dedicated to revolutionizing how data scientists and engineers build applications through our powerful open-source data platform, Daft. This isn't just another job; it's an opportunity to contribute to a project that operates on an astonishing 800k CPU cores daily! That’s more processing power than the largest supercomputer in the world! As part of our tight-knit team, you will play a crucial role in designing and implementing the architectural backbone of Daft, optimizing user workloads with advanced query planning techniques, enhancing the execution engine for better memory stability, and refining our resource scheduling. With your strong experience in distributed data systems and systems programming languages like C++, Rust, or C, you'll engage in exciting challenges like integrating modern data lake technologies and innovating with ML/AI workloads. We value autonomy and collaboration, and as you grow with us, you'll help shape the future of distributed data technologies while enjoying flexibility with hybrid work arrangements and top-tier benefits. If you're ready to wear many hats and dive deep into the transformative world of data, we’d love to see you thrive at Eventual!

Frequently Asked Questions (FAQs) for Software Engineer, Core Engine Role at Eventual
What responsibilities does a Software Engineer on the Core Engine team at Eventual have?

As a Software Engineer on the Core Engine team at Eventual, you'll be responsible for building key capabilities in our distributed data engine, Daft. Your main duties will include enhancing the planning/query optimizer to intelligently optimize user workloads, improving the memory stability of the execution engine with innovative data structures, and refining the distributed scheduler for better resource utilization and fault tolerance. You'll also work on enhancing integrations with modern data lake technologies like Apache Parquet and Delta Lake.

Join Rise to see the full answer
What qualifications are required for the Software Engineer position at Eventual?

To be considered for the Software Engineer position at Eventual, candidates should have at least 3 years of experience working with distributed data systems. A strong foundation in systems programming is essential, ideally with fluency in languages such as C++, Rust, or C. Familiarity with cloud technologies like AWS S3 will also be beneficial. Most importantly, we seek candidates who can thrive in small, dynamic teams with fast iterations.

Join Rise to see the full answer
What kind of work environment can Software Engineers expect at Eventual?

At Eventual, we embrace a hybrid work model that allows for flexibility while emphasizing the importance of in-person collaboration. We typically require at least 3 days of in-person work at our San Francisco office, fostering teamwork and innovation. Our culture thrives on autonomy, encouraging our Software Engineers to take initiative and contribute to various aspects of our projects.

Join Rise to see the full answer
What benefits do Software Engineers receive when working at Eventual?

Software Engineers at Eventual enjoy an array of benefits designed to support their well-being and professional growth. We offer best-in-class compensation, meal allowances, and comprehensive health coverage including medical, dental, and vision. We firmly believe in creating a supportive environment that allows our team members to excel in their roles and maintain a healthy work-life balance.

Join Rise to see the full answer
How does the interview process work for the Software Engineer role at Eventual?

The interview process at Eventual for the Software Engineer role consists of several key stages. It begins with a 15-minute introductory call to get acquainted, followed by a one-hour technical phone screen to assess your abilities. Next, candidates will engage in a four-hour technical interview panel with the Eventual team to discuss their strengths, weaknesses, and relevant experiences. We also encourage candidates to meet with various team members to gauge cultural fit and share insights.

Join Rise to see the full answer
Common Interview Questions for Software Engineer, Core Engine
What experience do you have with distributed data systems?

When discussing your experience with distributed data systems, be specific about systems you've worked with, such as Hadoop or Spark. Describe the projects you've been involved in, focusing on your role in query planning, scheduling, or fault tolerance, demonstrating your understanding of core concepts and challenges in this area.

Join Rise to see the full answer
Can you explain how you optimize query performance in a distributed system?

In answering this question, outline your approach to query optimization, highlighting techniques such as indexing, partitioning, or workload balancing. Provide examples from past experiences where you successfully improved query performance, and be prepared to discuss the trade-offs of the methods you chose.

Join Rise to see the full answer
Describe a challenging technical problem you faced and how you solved it.

Select a relevant technical challenge that showcases your problem-solving skills. Describe the problem, the steps you took to analyze it, and the ultimate solution. Reinforce your answer with the impact your solution had on the project or company, emphasizing your analytical thinking and technical expertise.

Join Rise to see the full answer
What programming languages are you comfortable with, and how have you applied them?

List the programming languages you're comfortable with, specifically mentioning systems programming languages like C++, Rust, or C. Discuss how you have used these languages in your previous roles to develop distributed systems or other relevant projects, providing specific scenarios that highlight your proficiency.

Join Rise to see the full answer
How do you approach working in a small team with tight deadlines?

Emphasize your ability to communicate effectively and collaborate in a compact team. Share examples where you've successfully contributed to team efforts under tight deadlines, detailing how you manage your time, prioritize tasks, and support your colleagues to achieve shared goals.

Join Rise to see the full answer
What cloud technologies have you worked with, and how did they enhance your projects?

Mention specific cloud technologies you are familiar with, such as AWS S3 or Google Cloud. Discuss how you integrated these solutions into your projects and the advantages they provided, such as scalability or data storage efficiency, reinforcing your understanding of cloud infrastructure.

Join Rise to see the full answer
How would you ensure the reliability and fault tolerance of a distributed system?

Discuss your strategies for building reliable and fault-tolerant systems, such as monitoring resource usage, implementing retry mechanisms, and maintaining redundancy. Provide an example of a system you worked on, illustrating the steps you took to enhance reliability.

Join Rise to see the full answer
What is your understanding of data lakes, and how do they relate to distributed computing?

Outline the concept of data lakes and their role in storing large volumes of structured and unstructured data. Explain how they relate to distributed computing by discussing technologies like Apache Parquet or Delta Lake, detailing how you have utilized these in your work to support big data operations.

Join Rise to see the full answer
Can you provide an example of a successful project you worked on involving ML/AI?

Select a project where you played a key role in implementing machine learning or AI technologies. Describe the objectives of the project, your specific contributions, and the outcomes, highlighting your problem-solving capabilities and understanding of data engineering.

Join Rise to see the full answer
What excites you about working on the Core Engine team at Eventual?

Share your enthusiasm for Eventual’s mission and innovative approach to data technology. Discuss specific attributes that draw you to the Core Engine team, such as the opportunity to optimize distributed queries or work with cutting-edge technologies, illustrating your passion for the field.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Posted 13 hours ago
Photo of the Rise User
Box Hybrid Redwood City, California, United States
Posted 3 hours ago
Customer-Centric
Dare to be Different
Diversity of Opinions
Feedback Forward
Take Risks
Growth & Learning
Transparent & Candid
Photo of the Rise User
PA Consulting Remote York St, Manchester, UK
Posted 8 days ago
Photo of the Rise User
TensorWave Hybrid Las Vegas, Nevada
Posted yesterday
Photo of the Rise User
Posted yesterday
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
January 9, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
146 people applied to Scrum Master-Remote at DICE
Photo of the Rise User
Someone from OH, Sandusky just viewed Head of IT/Security at Aerones
Photo of the Rise User
Someone from OH, Sandusky just viewed Vice President, Technology at MedVA
I
Someone from OH, Sandusky just viewed IT Manager at Infinite Locus
Photo of the Rise User
29 people applied to Senior PLSQL Developer at ProArch
Photo of the Rise User
Someone from OH, Cincinnati just viewed Finance Associate at Street Diligence
M
Someone from OH, Sandusky just viewed Director of Security, IT, & Compliance at Murmuration
W
Someone from OH, Sandusky just viewed Enterprise Technology Director at World Central Kitchen
Photo of the Rise User
Someone from OH, Sandusky just viewed Director of IT at Kyo
Photo of the Rise User
Someone from OH, North Ridgeville just viewed Remote Manager in Training- CS/Sales at Global Elite
Photo of the Rise User
Someone from OH, Cleveland just viewed Software Engineer I (DevOps) at Mastercard
C
Someone from OH, Warren just viewed Front End Developer (for AI Agent) at CyberCare
I
Someone from OH, Warren just viewed Senior Angular Lead at Integrators services a.s.
Photo of the Rise User
Someone from OH, Warren just viewed SSr. Front End Engineer (Angular.js) at NTD Software
Photo of the Rise User
Someone from OH, Warren just viewed Front-End Developer at Apex Logic
S
Someone from OH, Warren just viewed Angular Developer at Sparkland
Photo of the Rise User
Someone from OH, New Albany just viewed Diversity, Equity & Inclusion Manager at Axios
Photo of the Rise User
Someone from OH, Cincinnati just viewed Customer Service Associate at 2K
Photo of the Rise User
Someone from OH, Marion just viewed Casting: '2' at Backstage
Photo of the Rise User
Someone from OH, Westerville just viewed Junior Videographer at HyperionDev
Photo of the Rise User
Someone from OH, Columbus just viewed Part-time driver | Columbus, OH at Uber
Photo of the Rise User
Someone from OH, Columbus just viewed Operations Manager, Overnight at hims & hers
Photo of the Rise User
Someone from OH, North Ridgeville just viewed Court Security Officer, Juneau, AK at Walden Security