Senior Data Engineer (f/m/d)

As a Senior Data Engineer at adjoe, your main responsibilities include designing and maintaining a scalable feature store for machine learning applications, building robust data pipelines to process large-scale event data, and ensuring data quality and integrity across various datasets. You'll also bridge the gap between data science and backend teams, which is crucial for seamless integration and effective usage of data throughout the organization.

To qualify for the Senior Data Engineer role at adjoe, candidates should have a minimum of 3 years of software development experience, particularly in modern data engineering stacks. Proficiency in Python and SQL is required, while knowledge of Golang is a plus. Experience with distributed systems, scheduling frameworks like Airflow or Kubeflow, and concepts of data quality and feature stores are also essential.

adjoe utilizes a modern tech stack that includes Apache Kafka as a data bus system, Go for backend programming, Kubernetes and Terraform for infrastructure management, and various data storage solutions such as S3, Redis, and ClickHouse. Familiarity with these technologies, along with a willingness to explore new tools, will be beneficial for the Senior Data Engineer position.

adjoe emphasizes professional development with regular feedback, access to a development program, and opportunities to expand skill sets tailored to individual career goals. You'll be supported in your development journey as a Senior Data Engineer, ensuring you have the resources necessary to thrive and grow in your career.

Senior Data Engineers at adjoe can enjoy a range of benefits, including a hybrid work environment, generous vacation days, a relocation package for moving to Hamburg, and access to in-house wellness programs. The company also promotes work-life balance and community engagement through regular team and company events.

In your response, emphasize specific projects where you've created or maintained data pipelines, highlighting the technologies used such as Apache Kafka or any frameworks like Airflow. Discuss your approach to ensuring data integrity and the challenges you overcame while processing large volumes of data.

To answer this, share specific methodologies you use for data validation, monitoring, and governance. Explain any experience with implementing automated tests or checks and how those processes impacted overall data reliability within the systems you worked on.

Discuss your proficiency with tools such as Python (including libraries like pandas and NumPy), SQL for querying databases, and any other relevant tools you've utilized for data extraction and transformation processes. Highlight how these tools helped you achieve your goals in previous roles.

Talk about your previous roles where teamwork was essential. Emphasize your communication skills and how you worked with cross-functional teams, particularly how you acted as a bridge between data science and backend engineering teams, facilitating smooth workflows and ensuring alignment on projects.

Share a systematic approach to troubleshooting, which may include identifying data anomalies, digging through logs or querying the data for inconsistencies, and collaborating with team members to resolve issues. Use examples from prior experiences to illustrate your problem-solving skills.

Convey your enthusiasm for continuous learning by mentioning specific conferences, online courses, or blogs you've followed. Discuss any recent advancements in data engineering you're particularly excited about and how they could be applied at adjoe.

Explain your grasp of feature stores, defining their purpose in machine learning workflows. Discuss any experience you've had with implementing or utilizing feature stores, and how they contribute to the efficiency and effectiveness of model training and deployment.

Share a story where you faced unexpected challenges that required altering your initial plans. Discuss your decision-making process, the outcome, and lessons learned, showcasing your adaptability and resilience as a data engineer.

Illustrate your project management skills by describing strategies you use to prioritize tasks effectively. Mention tools or frameworks you use, and explain how you ensure alignment with team goals while managing your workload.

Express your excitement about adjoe's innovative approach in the mobile advertising industry. Mention your alignment with the company's values, the technologies they work with, and how you believe your skills can significantly contribute to the adtech platform's growth.