Senior Data Engineer / Architect
- Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks.
- Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights.
- Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks.
- Ensure data quality, integrity, and security throughout all stages of the data lifecycle.
- Collaborate with cross-functional teams to design and implement data models, schemas, and storage solutions.
- Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features.
- Provide technical guidance and expertise to junior data engineers and developers.
- Stay up to date with emerging trends and technologies in cloud computing, big data, and data engineering.
- Contribute to the continuous improvement of data engineering processes, tools, and best practices.
- Bachelor’s or master’s degree in computer science, engineering, or a related field.
- 10+ years of experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data solutions.
- Strong experience with cloud platforms such as Azure or AWS.
- Proficiency in Apache Spark and Databricks for large-scale data processing and analytics.
- Experience in designing and implementing data processing pipelines using Spark and Databricks.
- Strong knowledge of SQL and experience with relational and NoSQL databases.
- Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services.
- Good understanding of data modelling and schema design principles.
- Experience with data governance and compliance frameworks.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills to work effectively in a cross-functional team.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Contribute as a Senior Data Engineer driving analytics and scalable data solutions at EvenUp, a pioneering AI startup in personal injury law.
Experienced Senior Data Engineer opportunity at Pacific Life to develop scalable data pipelines and drive data solutions in an onsite Newport Beach team.
A forward-looking finance technology firm is searching for a Senior Data Engineer skilled in cloud platforms, data pipelines, and financial data architecture to drive innovation and data governance.
Experienced Data Engineer needed at KBR to support DoD Test and Evaluation data analytics and develop innovative data solutions for national security projects.
Contribute to SchoolAI’s growth by designing and maintaining scalable BI data pipelines in a dynamic startup environment.
Modivcare is hiring a Data Engineer III to develop robust ELT/ETL pipelines and data solutions in a fully remote role.
Innovative Data Engineer role at Swiftly, a Series C startup empowering grocers with cutting-edge Azure and Databricks powered retail solutions.
Seeking a skilled AI Data Engineer at DPR Construction to drive semantic layer integration and develop advanced AI-ready data models for enterprise-wide knowledge representation.
As a Staff Data Engineer at Bolt, you'll architect and scale data systems that power innovative financial and commerce solutions in a remote-first, inclusive environment.
Tyndale seeks an experienced Data Engineer to design and optimize data pipelines supporting advanced AI and machine learning projects within a hybrid work setting.
Contribute as a Data Engineer II to build advanced AI and data science pipelines supporting mission-critical DoD initiatives within Agile Defense.
Experienced Senior Data Engineer needed to develop and optimize complex data architectures and pipelines in support of the National Park Service’s mission.
Experienced Data Engineer II sought to innovate with Microsoft Teams data engineering team handling large scale data and collaborating cross-functionally in Redmond.
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
