Letโ€™s get started
By clicking โ€˜Nextโ€™, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Scala Spark Application Developer image - Rise Careers
Job details

Scala Spark Application Developer

The Opportunity

We're looking for a talented Scala Spark Application Developer to join our early stage startup team and drive the core development of our platform's dataplane. Unlike typical Scala/Spark roles that focus on services or project-based work, this position is uniquely centered on building a sophisticated product platform. You will design and develop the dataplane of our platform - a cutting-edge Spark-based analytics engine with embedded inductive learning capabilities that forms the foundation of our data quality intelligence.

In this role, you'll architect and implement the mathematical and computational core that powers our anomaly detection algorithms. You'll work with complex statistical models, real-time data processing, and concurrent systems that operate at enterprise scale across multiple cloud environments. Our platform doesn't just process data - it learns from it, and you'll be building the brain that makes that possible.

What You'll Do

  • Design and implement the core dataplane architecture for our Spark-based analytics engine

  • Develop sophisticated statistical algorithms and inductive learning models for automated data quality inference

  • Build high-performance, concurrent data processing pipelines using Scala and Spark that handle enterprise-scale workloads

  • Implement asynchronous processing patterns and reactive systems for real-time anomaly detection and alerting

  • Collaborate with our CTO & our customers to invent & embed statistical models directly into the Spark execution engine

  • Optimize query performance and data processing efficiency across distributed computing clusters

  • Design and implement advanced SQL generation and optimization for complex analytical workloads

  • Build robust error handling and fault tolerance mechanisms for mission-critical data processing

  • Establish best practices for functional programming, concurrent system design, and mathematical computation accuracy

  • Mentor team members on Scala, functional programming principles, and advanced Spark optimization techniques

  • Collaborate cross-functionally with product, infrastructure, and customer success teams to deliver a world-class platform

  • Give & receive constructive feedback that makes the overall team and product stronger

Who You Are

  • Enjoys working with excellent team members while maintaining high personal standards

  • Collaborates extremely well with teammates โ€“ we want people to have fun working with you

  • Has desire and ability to work both independently on complex algorithmic problems

  • Comes with an optimistic attitude towards problem solving and continuous learning

  • Brings experience and passion for building high-performance, mathematically rigorous systems

  • Has a deep appreciation for functional programming principles and their application to distributed computing

  • Takes a thoughtful approach to architectural decisions, balancing performance, maintainability, and mathematical correctness

  • Has strong analytical thinking skills and enjoys perfecting algorithms that solve real-world data problems

Requirements

Experience: 3+ years of experience with Scala development and distributed systems

  • Core Technologies: 2+ years of hands-on Apache Spark development experience

  • Mathematical Foundation: Strong background in statistics, linear algebra, and mathematical analysis

  • SQL Mastery: Advanced SQL skills with experience in query optimization and performance tuning

  • Concurrent Programming: Proficiency in asynchronous and concurrent programming patterns in Scala

  • Functional Programming: Deep understanding of functional programming concepts and their practical application

  • Data Engineering: Experience with large-scale data processing, ETL pipelines, and data quality frameworks

  • Database Systems: Familiarity with multiple datastores (PostgreSQL, Snowflake, RedShift, etc.)

  • Version Control: Proficiency with Git and collaborative development workflows

Nice to Have

  • ZIO Experience: Hands-on experience with ZIO for functional effects and concurrent programming

  • Machine Learning: Background in ML model development and statistical learning theory

  • Streaming Systems: Experience with real-time data streaming (Kafka, Kinesis, etc.)

  • Cloud Platforms: Experience with cloud-native Spark deployments (EMR, Dataproc, Databricks)

  • Performance Optimization: Experience with JVM tuning and Spark performance optimization

  • Academic Background: Advanced degree in Computer Science, Mathematics, Statistics, or related field

  • Product Development: Experience building data platform products (vs. project-based analytics)

  • Startup Experience: Previous experience working in fast-paced startup environments

  • Enterprise Experience: Experience working with enterprise-scale data systems and customers

Why Work Here?

Mission

We founded Qualytics based on our collective experiences working at a number of early-stage technology companies grappling with challenges related to data quality. We realized how few products are available to help organizations maintain quality & trust in their data pipelines. We're here to change that with a platform capable of detecting and proactively responding to data anomalies before they result in ML model drift, corruption of your aggregated calculations, or other pollution of your downstream systems. We believe that data is the most valuable resource to companies, and that resource isn't useful unless it's reliable.

Values

Qualytics is a values-driven organization, and we are excited about what we do. We're flexible, honest, hardworking, and collaborative. As a team, we bring our diverse backgrounds, beliefs, and experiences together to create better individual work experiences. We support and challenge one another to bring out the best in each of us, and it seems like we have a little fun along the way. We are lifelong learners, and support ongoing training and professional development on a wide variety of topics.

Perks

  • Competitive salary and equity: we pay up for great talent

  • Unlimited vacation โ€“ we trust you to take what you need โ€“ we clear the calendars on common holidays so you don't feel like you're going to miss an important meeting if you take off

  • All the benefits: medical, dental, and vision insurance, the works

  • Work with a passionate and dedicated team

  • Fun environment with like minded individuals who enjoy a company giphy conversation on slack more than they should

Please note that while the position is remote, we currently require applicants to be located in the United States and cannot offer visa sponsorship at this time.

Average salary estimate

$120000 / YEARLY (est.)
min
max
$100000K
$140000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Qualytics Hybrid No location specified
Posted 2 days ago

Qualytics seeks a strategic and hands-on VP of Sales to lead enterprise B2B sales and scale revenue growth in a cutting-edge data quality platform company.

Photo of the Rise User
Posted 11 days ago
Inclusive & Diverse
Empathetic
Collaboration over Competition
Growth & Learning
Transparent & Candid
Medical Insurance
Dental Insurance
Mental Health Resources
Life insurance
Disability Insurance
Child Care stipend
Employee Resource Groups
Learning & Development

Contribute as a Frontend Engineer at American Express within their Enterprise Architecture team, focusing on React development and technology strategy.

Photo of the Rise User
Posted 3 days ago

R1 is looking for a Manager of Software Engineering to lead a remote team developing advanced healthcare technology solutions.

Photo of the Rise User
Abbott Hybrid United States - California - Pleasanton
Posted yesterday

Lead Abbott's Software Engineering organization to create high-quality medical device and digital health software using modern technologies and SAFe Agile practices.

Photo of the Rise User

AlphaSense invites an accomplished Senior Software Engineer to enhance their metadata ingestion and normalization systems that serve millions of companies worldwide.

Photo of the Rise User

Senior MS Dynamics Developer / Team Lead needed to lead technical development and team collaboration on government IT transformation projects in a hybrid Washington D.C. setting.

Photo of the Rise User
Inclusive & Diverse
Mission Driven
Social Impact Driven
Passion for Exploration
Dare to be Different
Diversity of Opinions
Reward & Recognition
Empathetic
Feedback Forward
Work/Life Harmony
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Rise from Within
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Learning & Development
Work Visa Sponsorship
Employee Resource Groups
401K Matching
Paid Time-Off
Maternity Leave
Social Gatherings
Company Retreats

Drive security innovation as a Principal Software Engineer at Microsoft AI, safeguarding Copilot by designing robust, cutting-edge AI data and privacy solutions.

Photo of the Rise User

Lead the productionization of cutting-edge AI/ML prototypes as a Full-Stack ML and DevOps Engineer in a remote role at Natera, driving clinical innovation through scalable software.

Experienced senior software engineers are needed to independently develop frontend and backend features for an innovative design marketplace platform in a fully remote contract role.

Photo of the Rise User
NBCUniversal Hybrid 904 Sylvan Ave, Englewood Cliffs, NEW JERSEY
Posted yesterday

Lead NBCUniversal's OTC and CAPM engineering teams to design and deploy SAP BTP cloud applications driving business transformation.

Posted 2 days ago

Shape the future of a meditation app as a part-time React Native Developer working remotely with a visionary founder.

Photo of the Rise User

Experienced Embedded Software Engineer wanted at Zoox to develop robust embedded software for autonomous vehicle platforms.

Photo of the Rise User
Posted 12 days ago
Inclusive & Diverse
Empathetic
Collaboration over Competition
Growth & Learning
Transparent & Candid
Medical Insurance
Dental Insurance
Mental Health Resources
Life insurance
Disability Insurance
Child Care stipend
Employee Resource Groups
Learning & Development

Experienced Senior Software Engineer needed by American Express to lead and build innovative full-stack expense management solutions.

Photo of the Rise User
Posted 13 days ago

Innovative Software Engineer role at Skyward to build advanced AI solutions and contribute to transformative government tech initiatives.

MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
HQ LOCATION
No info
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
June 3, 2025

Subscribe to Rise newsletter

Risa star ๐Ÿ”ฎ Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY