Job details

AD - Data Engineer - 0007

Get a free resume review

Job Summary

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data processing and analytics, with expertise in Python and SQL. You will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the integrity and availability of data for analysis. This role requires collaboration with data scientists, analysts, and other stakeholders to support data-driven decision-making across the organization.

Job Responsibilities

Design, develop, and maintain robust data pipelines to process large volumes of data from various sources.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
Optimize data storage and retrieval processes to improve performance and efficiency.
Implement data quality checks and monitoring to ensure the accuracy and reliability of data.
Work with cloud-based technologies, particularly Databricks, to manage and analyze data.
Participate in Agile development processes, including sprint planning and retrospectives using Jira.
Document data processes, architectures, and workflows for future reference and compliance.
Stay updated with industry trends and best practices in data engineering and analytics.

Proficient in Python as a core programming language for data manipulation and analysis.
Strong knowledge of SQL for querying databases and performing data transformations.
Experience with PySpark for processing large datasets in a distributed computing environment.
Familiarity with Databricks is a plus, enabling efficient data processing and collaboration.
Understanding of data warehousing concepts and ETL processes.
Experience working in Agile environments, particularly with Scrum methodologies (not as a Scrum Master).
Proficient in using Jira for project management and tracking progress.
Minimum of 3 years of experience in data engineering or related fields.
Proven track record of building and maintaining data pipelines in production environments.
Excellent communication skills to effectively collaborate with cross-functional teams.
Strong problem-solving abilities and attention to detail.

Average salary estimate

$105000 / YEARLY (est.)

min

max

$90000K

$120000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About AD - Data Engineer - 0007, Thaloz

Hey there! If you're passionate about data and looking to make an impact, we have an exciting opportunity for you. At our company, we're on the hunt for a talented Data Engineer to join our vibrant team. As a Data Engineer, you’ll be at the forefront of designing, building, and maintaining scalable data pipelines that handle vast amounts of information from various sources. You will collaborate closely with our data scientists and analysts, ensuring that everyone has access to the high-quality datasets they need for informed decision-making. Your expertise in Python and SQL will shine as you optimize data storage and retrieval processes, implement data quality checks, and manage cloud-based technologies like Databricks. We're big on teamwork, so your excellent communication skills and knack for problem-solving will be crucial. With a minimum of 3 years of experience in data engineering under your belt, you understand the ins and outs of data warehousing, ETL processes, and Agile development methodologies. If you’re ready to dive into an environment that values innovation and collaboration, consider joining us as our next Data Engineer and help us elevate our data game!

Frequently Asked Questions (FAQs) for AD - Data Engineer - 0007 Role at Thaloz

What are the primary responsibilities of a Data Engineer at our company?

As a Data Engineer at our company, you will be responsible for designing, developing, and maintaining robust data pipelines that process large volumes of data, collaborating with data scientists and analysts to deliver high-quality datasets, and optimizing data storage and retrieval processes to improve overall performance.