Lead Data Engineer

We are looking for an experienced Lead Data Engineer to join our team at Artsy. You will join the Artsy Engineering Team with a mission to support the Artsy product with a strong data foundation. This includes data from our own platform as the largest online art marketplace, as well as external data sets and integrations. Data informs much of Artsy’s product and decision-making, from search and personalization to auction results and internal analytics.

As a Lead Data Engineer, you’ll evaluate tools and approaches to establish a modern, best-in-class data platform serving Artsy’s end users as well as internal analysts and stakeholders. You’ll have the opportunity to build and lead Artsy’s data engineering team, with both hands-on impact and influence on the tools and processes we adopt.

You’ll collaborate with other tech leads and product managers to influence how we can build best-in-class products leveraging our comprehensive data. You’ll work on pipelines, databases, and APIs as well as critical services such as search, recommendations, and market insights. You’ll architect systems for scale, and you’ll think about how to keep our complex, distributed platform resilient to data integrity issues or service disruptions. You’ll help structure our data so it’s an invaluable asset in our dynamic business environment.

We are a lean team that relies on Ruby for back-end services, Python for machine learning, Scala for data processing, and SQL for enrichment and analysis. Our stack includes Postgres, Elasticsearch, Redshift, RabbitMQ, Airflow, Spark, and Hive. We integrate with services like Segment and Looker to accomplish our work and are always evaluating new patterns, tools, and technologies.

What You’ll Do:

Some areas you’ll be expected to contribute to in the coming months:

• Set the direction for Artsy’s data infrastructure, establishing technology, tools and processes around quality and reliability.
• Collaborate regularly with other engineers, data analysts, and product managers.
• Help to hire, develop, and lead other data engineers.
• Empower a data-driven culture by making high-volume activity data rapidly available for analysis.
• Build and operate production pipelines and models.
• Ingest and aggregate data from both internal and external data sources to build our world-class datasets.
• Transform the growing body of art market data we’ve collected into meaningful insights about artists, artworks, and trends.
• Contribute to machine learning models that aid in ranking, classification, and predictive tasks such as recommendations and similarity.

Who You Are:

We welcome you to apply regardless of “checking all the boxes” below, and are excited to hear what you can bring to the team.

• This role will be based in Berlin.
• You bring a proven track record of leading data strategy and supporting other data engineers.
• You are experienced in building user-facing products powered by data.
• Experience with large-scale data processing or enrichment and are knowledgeable about data modeling, data access, and data storage techniques.
• You have a leadership mindset and bring prior experience mentoring engineers, managing others, or leading a team.
• Proactive approach to problem solving and are excited to build and expand Artsy’s data engineering team.
• Understand the value of collaboration within teams, and have experience building relationships with a diverse set of stakeholders.
• Data science and machine learning experience in a complex product environment would be helpful, however not essential.

What We Offer:

• Opportunity to reimagine the art industry while working with a talented, diverse, international team.
• Competitive salary and equity
• Flexible time off: we empower Artsy employees to take time off based on their desires and needs that matter most to them
• We are a distributed-first company where employees have the flexibility to work from home. Offices are available for employees in New York, London, and Berlin. (In-person recommendations, and location will vary by role)
• Benefit options, including: German language subscription, global travel insurance, mental health resources, fitness and virtual workout resources, fertility and parenthood support, standard pension & healthcare enrollment, parental and medical paid leave, and more
• Professional development, including: mentoring, lunch & learns, regular training, 1:1 management, and an open feedback culture
• Engaging opportunities and internal programming globally, to foster new relationships and build upon our collaborative community. Including: happy hours, holiday parties, global “All Hands” meetings, “Artsy Salon” (a yearly exhibition of our team’s creativity), attendance to art world events, and more

About Artsy Engineering:

Artsy’s engineering principles are open source. We encourage knowledge building and sharing within the larger tech community through open source software, blog posts, and other free resources. Artsy would rather proudly discover (and improve) an existing tool than build it ourselves from scratch. Through our work, we try to create more value than we capture. That means that when we learn something new, we try to share that knowledge through blog posts and open source documentation. A successful candidate will bring their own unique perspective to help us achieve this mission.

Artsy’s mission is to expand the art market to support more artists and art in the world. Artsy has created the world’s largest two-sided art marketplace, offering more than 1 million works by 100,000 artists from 4,000 leading galleries, fairs, auction houses, and institutions across 190 countries.Artsy Values

Artsy has five core values that will inform your experience at Artsy.

For the Love of Art: We have relentless curiosity, empathy, and passion for collectors, artists, and the art market. We are here to make the art world more fair and welcoming.

Own Our Outcomes: We are all individual owners of Artsy’s shared success. We are resourceful and resilient, and to get the job done, we each take responsibility for our outcomes.

Lead with Openness: We trust in our teammates. We seek diverse perspectives, communicate authentically, and act with integrity. A more open art world starts with us.

Transform Together: Our mission asks us to challenge the status quo. We embrace feedback, learning, and change so that we can transform our industry, our company, and ourselves.

Impact Over Perfection: Using both art and science, we debate and decide swiftly and iterate on our plans as we learn. To make the biggest impact, we prioritize speed and clarity of action over perfection.

ARTSY IS AN EQUAL OPPORTUNITY EMPLOYER. WE VALUE A DIVERSE WORKFORCE AND AN INCLUSIVE CULTURE. WE ENCOURAGE APPLICATIONS FROM ALL QUALIFIED INDIVIDUALS WITHOUT REGARD TO RACE, COLOR, RELIGION, GENDER, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, AGE, NATIONAL ORIGIN, MARITAL STATUS, DISABILITY, AND VETERAN STATUS.