Sr. Data Engineer, Premium Analytics - Juniper AIDE

Responsibilities

• Develop and optimize large-scale batch and real-time data pipelines that ingest structured and unstructured data from diverse sources, ensuring data quality and availability.

• Manage incoming data requests and prioritize projects in an organized manner, ensuring that the highest value projects are given priority.

• Assist in scaling our Snowflake and Looker setup, optimizing their performance and ensuring their reliability.

• Utilize advanced SQL skills to craft innovative data solutions that meet the needs of our stakeholders, enabling them to make data-driven decisions.

• Monitor and alert on Airflow jobs and data pipelines to ensure that they are operating as expected and take corrective actions when necessary to ensure that data is delivered on time and of high quality.
  

Requirements

• Bachelor's or Master's degree in Computer Science, Data Science or a related field.

• 8+ years of experience in a data engineer or SQL-heavy data analyst role, preferably in a startup environment.

• Proven track record of success in building new data engineering processes and ability to work effectively in an ambiguous and fast-paced environment.

• Databases: experience with Snowflake, Databricks or equivalent technologies.

• Clouds: experience with AWS, GCP or other cloud providers.

• Excellent SQL knowledge and experience with ETL concepts.

• Experience with reporting tools such as Looker, Tableau, Sisense or similar.

• Knowledge of EMR, Spark, ElasticSearch, Cassandra, Postgres, Airflow, and shell scripting.

• Familiarity with multi-tenancy and monitoring of data pipelines.
  

If you are a motivated data engineering professional with a passion for solving complex problems and developing innovative solutions, we encourage you to apply for this exciting opportunity.