Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Software Engineer (Ray Core) image - Rise Careers
Job details

Software Engineer (Ray Core)

About Anyscale:


At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAIUberSpotifyInstacartCruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.


With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.


Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.


About the role

Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.


About the Ray Core Team

The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.


A snapshot of projects you can work on:

- Optimizing performance of large-scale workloads on Ray

- Stability and stress testing infrastructure

- Improving fault tolerance (HA)

As part of this role, you will:

  • Develop high quality open source software to simplify distributed programming (Ray)

  • Identify, implement, and evaluate architectural improvements to Ray core

  • Improve the testing process for Ray to make releases as smooth as possible

  • Communicate your work to a broader audience through talks, tutorials, and blog posts

We'd love to hear from you if have:

  • At least 2 year of relevant work experience

  • Solid background in algorithms, data structures, system design

  • Experience in building scalable and fault-tolerant distributed systems

  • Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred

  • Knowledge of GPU programming is preferred

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 


Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Average salary estimate

$110000 / YEARLY (est.)
min
max
$90000K
$130000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Software Engineer (Ray Core), Anyscale

Join Anyscale as a Software Engineer (Ray Core) and be part of our mission to democratize distributed computing! At Anyscale, we're passionate about making distributed systems accessible for developers of all skill levels by commercializing Ray, an amazing open-source project. Imagine working on cutting-edge projects that power AI applications for big names like OpenAI, Uber, and Spotify! As a Software Engineer on our Ray Core team, you'll be diving deep into the Ray C++ backend, focusing on enhancing performance, reliability, and scalability. You'll play a pivotal role in optimizing large-scale workloads, improving fault tolerance, and ensuring that Ray delivers the right features for various higher-level libraries. We believe in fostering a collaborative and innovative environment, where engineers like you can develop high-quality open-source software and contribute to architectural improvements. And don't worry, we value your ideas and insights—we encourage communication of your work through talks, tutorials, and blog posts. If you have a solid background in algorithms, system design, and distributed systems, we'd love to hear from you! Let's work together to create powerful tools that simplify distributed programming and transform the future of machine learning!

Frequently Asked Questions (FAQs) for Software Engineer (Ray Core) Role at Anyscale
What are the primary responsibilities of a Software Engineer (Ray Core) at Anyscale?

As a Software Engineer (Ray Core) at Anyscale, your main responsibilities include developing high-quality open-source software to enhance Ray, contributing to the backend development, and ensuring the system's reliability and performance. You'll also be involved in optimizing the infrastructure for large-scale workloads, improving fault tolerance, and communicating your findings through various channels.

Join Rise to see the full answer
What qualifications are required for the Software Engineer (Ray Core) position at Anyscale?

To qualify for the Software Engineer (Ray Core) position at Anyscale, applicants should have at least 2 years of relevant experience, a solid understanding of algorithms, data structures, and system design. Experience in building scalable, fault-tolerant distributed systems, as well as knowledge of distributed model training and GPU programming, is preferred.

Join Rise to see the full answer
What kind of projects can a Software Engineer (Ray Core) expect to work on at Anyscale?

In the Software Engineer (Ray Core) role at Anyscale, you'll engage in exciting projects such as optimizing performance for large-scale workloads, conducting stability and stress tests, and enhancing the fault tolerance of Ray. Your contributions will have a direct impact on improving the system's overall functionality and performance.

Join Rise to see the full answer
What methods does Anyscale use to ensure a smooth testing process for Ray?

Anyscale emphasizes the importance of an effective testing process for Ray. As a Software Engineer (Ray Core), you'll work on improving testing infrastructure to make releases smoother and more reliable. This includes developing automated testing frameworks and evaluating architectural improvements that enhance testing outcomes.

Join Rise to see the full answer
How does Anyscale support employee growth and communication?

Anyscale is committed to employee development. As a Software Engineer (Ray Core), you'll have opportunities to present your work through talks and tutorials, fostering a culture of sharing knowledge. We believe that effective communication and supporting your growth is essential for both personal and organizational success.

Join Rise to see the full answer
Common Interview Questions for Software Engineer (Ray Core)
Can you explain your experience with distributed systems in the context of the Software Engineer (Ray Core) role?

When answering this question, focus on specific projects you've worked on that involved building distributed systems. Discuss challenges you've faced, solutions you've implemented, and how these experiences make you a perfect fit for the Software Engineer (Ray Core) role at Anyscale.

Join Rise to see the full answer
What steps do you take to ensure the performance and reliability of a distributed application?

Outline your approach to performance tuning, including profiling tools and techniques you've utilized. Emphasize your understanding of reliability practices, such as failover strategies and fault isolation, which are crucial for a Software Engineer in the Ray Core team.

Join Rise to see the full answer
Describe a situation where you optimized a large-scale application’s performance.

Provide a detailed account of a specific instance where your optimization led to tangible improvements in performance. Discuss the strategies you used, the metrics you monitored, and the positive outcomes achieved, aligning your answer with Anyscale's mission.

Join Rise to see the full answer
How familiar are you with GPU programming, and how has it impacted your previous projects?

Talk about any projects where GPU programming played a significant role, explaining how it enhanced performance. Even if you have limited experience, express your eagerness to learn and the approaches you would take to become proficient in GPU programming as a Software Engineer at Anyscale.

Join Rise to see the full answer
What approaches do you use to handle testing in a distributed environment?

Discuss the testing frameworks you've used and the significance of automated testing in distributed systems. Highlight the importance of continuous integration and testing practices, showcasing your preparedness for the challenges within Anyscale's development process.

Join Rise to see the full answer
How do you keep up with advancements in distributed computing and machine learning?

Share your strategies for staying updated on trends and advancements in your field. Mention blogs, articles, courses, or conferences you've participated in, and put a spotlight on how staying informed helps you contribute effectively as a Software Engineer in the Ray Core team.

Join Rise to see the full answer
Can you explain any architectural improvements you have recommended or implemented in your past roles?

Provide a specific example where you identified architectural bottlenecks and proposed solutions. Outline the thought processes and frameworks that guided your recommendations and emphasize how they align with the responsibilities of the Software Engineer (Ray Core) role.

Join Rise to see the full answer
What do you think are the most critical factors for achieving scalability in distributed applications?

Highlight the key elements you believe are essential for scalability, such as load balancers, microservices, and state management. Bring in relevant experiences or projects that reinforce your understanding of scalability in relation to the Software Engineer (Ray Core) position.

Join Rise to see the full answer
How do you prioritize communication and collaboration in your work?

Discuss your strategies for effective communication and collaboration within your team. Highlight experiences where teamwork yielded successful project outcomes, emphasizing the importance of a collaborative environment as a Software Engineer (Ray Core) at Anyscale.

Join Rise to see the full answer
What excites you most about working as a Software Engineer (Ray Core) at Anyscale?

Show your enthusiasm for Anyscale's mission and the impact your work can have in democratizing distributed computing. Discuss how your values align with the company's goals, and express your eagerness to contribute to innovative projects that simplify distributed programming.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Posted 7 days ago

Join Anyscale as a Software Engineer to help build the infrastructure that enables developers to run distributed AI applications seamlessly in the cloud.

Photo of the Rise User
Anyscale Remote No location specified
Posted 8 days ago

Join Anyscale as a Product Security Engineer Leader, guiding security initiatives for innovative distributed computing solutions.

Photo of the Rise User

Join Docplanner as a ReactNative Mobile/Frontend Developer and be a part of a mission to improve healthcare experiences for millions.

Photo of the Rise User
Auria Hybrid No location specified
Posted 7 days ago

Auria welcomes an experienced Software Developer to join their Colorado Springs team, focusing on innovative solutions for complex satellite systems.

Photo of the Rise User
AstraZeneca Hybrid US - Gaithersburg - MD
Posted 3 days ago

Join Evinova as a Software Engineer to lead innovative solutions in patient recruitment and digital health.

Photo of the Rise User
Startup Mindset
Collaboration over Competition
Growth & Learning
Inclusive & Diverse

Cohere seeks a skilled Solutions Architect to enhance our Public Sector business in the UK with a focus on AI technologies.

Nucleus Ventures is on the lookout for a talented Ruby Developer to join their remote team and drive innovation across various web applications.

Photo of the Rise User
Posted 2 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony

Join Paychex as a Software Engineer II and contribute to innovative HR technology solutions in a supportive and inclusive environment.

Photo of the Rise User
Mindex Remote No location specified
Posted 9 days ago

Join Mindex as an Oracle CPQ Developer and be part of a team that delivers agile software solutions for leading organizations.

Photo of the Rise User
Posted 3 days ago

We are seeking a Front-End UI Developer proficient in Angular and AWS to join our Richmond team in a hybrid capacity.

We are building the future of software development.

47 jobs
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
April 3, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
Someone from OH, Columbus just viewed Customer Success Manager, US SLED at Dataminr
Photo of the Rise User
Someone from OH, Greenville just viewed Systems Engineer (Linux & Shell or Python scripting) at Visa
Photo of the Rise User
Someone from OH, Greenville just viewed Help Desk Technician - Youngstown at R.I.T.A.
Photo of the Rise User
Someone from OH, Greenville just viewed Junior Research Analyst at Fortress Information Security
Photo of the Rise User
Someone from OH, Mount Orab just viewed Backend Developer at G2i Inc.
Photo of the Rise User
Someone from OH, Cincinnati just viewed Product Marketing Manager at Cast & Crew
Photo of the Rise User
Someone from OH, Cincinnati just viewed Marketing Manager at Cast & Crew
o
Someone from OH, Cincinnati just viewed Administrative Assistant at osu
A
Someone from OH, Cincinnati just viewed Data Entry Clerk at Alphabe Insight Inc
Photo of the Rise User
Someone from OH, Cincinnati just viewed Machine Learning Engineer at Allstate
Photo of the Rise User
Someone from OH, Twinsburg just viewed Data Analyst/Power BI Developer at Datadog
Photo of the Rise User
Someone from OH, Cuyahoga Falls just viewed Small Fleet Underwriter at HDVI
Photo of the Rise User
Someone from OH, Dublin just viewed Product Designer, Entry Level at Govini
Photo of the Rise User
Someone from OH, Columbus just viewed Support Associate-7 at Tory Burch