Senior Data Engineer
About PrePass
PrePass® is North America's most trusted weigh station bypass and toll management platform. We’re transforming how the transportation industry operates—creating solutions that keep trucks moving safely, efficiently, and compliantly. This means making bold decisions and building systems that support not only fleets but the broader economy. It all starts with enabling commercial vehicles to keep rolling with seamless toll management, weigh station bypass, and safety solutions. It’s what we do best, and we do it to meet the demands of the road every day.
That’s why people join us: our solutions are implemented in real-time, on highways and interstates across the nation, helping fleets go farther, faster. This work challenges and rewards, presenting complex problems that need ambitious answers. We hire bold thinkers with a heart for impact, a passion for progress, and the optimism to shape the future of transportation.
Position Description
As a Senior Data Engineer, you will be responsible for designing and developing pipelines for data ingestion, processing, and distribution. Our solutions range from batch processing to real-time data streaming. You will be challenged with identifying innovative solutions to meet the needs of our growing business. The ideal candidate has a deep understanding of data engineering, particularly in building scalable and efficient data infrastructures on cloud environments. We are looking for someone who enjoys working in a fast-paced environment, who can take on complex challenges, and produce impactful solutions.
Key Responsibilities
- Develop and manage production ETL pipelines on the Azure cloud.
- Formulate complex SQL queries for transforming and collating data across multiple sources.
- Code data transformations and processing logic in Databricks.
- Troubleshoot data integration and data quality issues, diagnose failures, implement optimal solutions, and revise procedures.
- Tune and optimize cluster performance for cost, efficiency, scalability, and resource utilization.
- Partner with team to design and implement a strategy for re-architecting legacy SQL Server Integration Services [SSIS].
- Develop comprehensive solutions for traceability and observability.
- Contribute to documentation and maintain architecture diagrams.
- Participate in proof-of-concept exercises and prototyping. Provide analysis and recommendations based on your findings.
- Mentor and guide junior engineers, encourage a culture of learning.
Required
- Bachelor’s degree in computer science or equivalent experience.
- Typically, 6+ years of industry experience in data engineering.
- At least 3 years of experience providing technical leadership on large projects.
- Experience using Databricks for data engineering tasks.
- Expert in writing, analyzing, and tuning complex SQL queries.
- Advanced experience with design and data modeling.
- Programming proficiency in Python.
- Familiarity with big data technologies and frameworks such as Apache Spark and Delta Lake.
- Committed to delivering on value-added innovation. Eager to learn and experiment with new technology.
Preferred
- Experience with stream-processing systems like Apache Spark and Kafka.
- Familiarity of event driven architecture – queues, batches, and pub/sub models.
- Proficiency with reporting and data visualization tools, specifically PowerBI.
- Familiarity with data quality and governance principles and best practices.
- Versed in software engineering practices, version control, code reviews, unit testing, and CI/CD.
How We Will Take Care of You
- Robust benefit package that includes medical, dental, and vision that start on date of hire.
- Paid Time Off, to include vacation, sick, holidays, and floating holidays.
- 401(k) plan with employer match.
- Company-funded “lifestyle account” upon date of hire for you to apply toward your physical and mental well-being (i.e., ski passes, retreats, gym memberships).
- Tuition Reimbursement Program.
- Voluntary benefits, to include but not limited to Legal and Pet Discounts.
- Employee Assistance Program (available at no cost to you).
- Company-sponsored and funded “Culture Team” that focuses on the Physical, Mental, and Professional well-being of employees.
- Community Give-Back initiatives.
- Culture that focuses on employee development initiatives.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
At PrePass, we're revolutionizing the transportation industry, and we're on the lookout for an enthusiastic and talented Senior Data Engineer to join our team. In this pivotal role, you'll be diving deep into the world of data engineering, crafting pipelines for data ingestion, processing, and distribution. Imagine working with cutting-edge technology, like Azure and Databricks, to transform how fleets operate on highways across North America. It's not just about numbers; it's about making real-time decisions that keep trucks moving efficiently and safely. You'll tackle complex challenges, optimizing ETL pipelines and SQL queries to enhance our services. Plus, your expertise will lead the charge in re-architecting our legacy systems and driving innovation. At PrePass, we value bold thinkers who are eager to make a difference and inspire others. With a robust benefits package and a supportive culture focused on growth and community, you’ll find that making an impact here is both rewarding and fulfilling. If you're passionate about building scalable, efficient data infrastructures and mentoring the next generation of engineers, we want you on our team!
PrePass Safety Alliance is the non-profit provider of PrePass weigh station bypass and toll payment services. The Alliance was formed in 1993 by trucking industry leaders, enforcement agencies and state DOTs to improve the safety and efficiency of...
7 jobs
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
Sign up for our weekly
newsletter of fresh jobs
