Lead Data Engineer

We are looking for a Lead Data Engineer to join our growing team of Data Engineers and manage the processes and people responsible for accurate data collection, processing, modeling, and analysis.

You will work closely with leaders across product, sales, and marketing to support and implement high-quality, data-driven decisions. You will ensure accuracy and consistency in our reporting and decision support by designing appropriate data architectures, setting up alerting and observability frameworks and correcting business processes to prevent data quality issues. You will become an expert administrator of our data engineering technology stack, which includes dbt and Snowflake, and a coach to the rest of the team for these technologies.

This is a remote opportunity within the US. You will be expected to be fully remote, ideally in the Eastern Time Zone.

Responsibilities include, but are not limited to:

• Design, implement, and maintain data pipelines to support business objectives
• Implement tests, monitoring, and data quality processes to maintain data integrity and accuracy
• Diagnose and resolve performance issues with user SQL queries
• Diagnose and resolve failures of production systems in a timely manner
• Manage and mentor a team of data engineers, providing technical guidance, performance feedback, and coaching
• Collaborate with cross-functional teams to identify and prioritize projects, ensuring timely delivery and alignment with business goals
• Conduct ongoing research and evaluation to improve data infrastructure and processes
• Developing business continuity plans

Required Qualifications:

• Bachelor's degree in Computer Science or related field
• 8+ years of experience in data engineering, software development, or related field
• Expert knowledge of SQL
• Experienced at database administration for a relational or NoSQL database
• Experienced at performance tuning for databases & queries
• Professional experience using Git or another source code management system
• Professional experience using Linux for software development
• Strong technical skills in data architecture, data modeling, ETL, and data warehousing
• Strong project management and leadership skills
• Excellent interpersonal, teamwork, and problem-solving skills
• Strong communication skills, including the ability to explain intricate database concepts to other members of their team
• Ability to work in a fast-paced, collaborative environment
• Must be able to travel occasionally, and work more than 40 hours a week, as needed.

Preferred Qualifications:

• Experience with cloud analytical data warehouses (Snowflake preferred)
• Experience with data pipeline tools (dbt, Airflow, or similar)
• Experience with database replication including High Availability setups
• Experience operating & monitoring systems on cloud-based platforms (AWS preferred)
• Experience implementing statistical process control to monitor and control a data analytics pipeline (DataOps)
• Professional experience using Python for data processing
• Knowledge of Kimball dimensional modeling
• Knowledge of data security and privacy regulations such as GDPR, CCPA and good PII data practices to support their enforcement
• A plus if you love books!

This position will have an annual salary of $140,000-$165,000

Macmillan Publishers is the U.S. trade division of the Holtzbrinck Publishing Group, a large family-owned media company headquartered in Stuttgart, Germany. Its publishing companies include prominent imprints around the world that publish a broad range of award-winning books for children and adults in all categories and formats.

U.S. publishers include Celadon Books, Farrar, Straus and Giroux, Flatiron Books, Henry Holt & Company, Macmillan Audio, Macmillan Children’s Publishing Group, The St. Martin's Publishing Group, and Tor Publishing Group. In the UK, Australia, India, and South Africa, Macmillan publishes under the Pan Macmillan name. The German company, Holtzbrinck Deutsche Buchverlage, includes among its imprints S. Fischer, Kiepenheuer & Witsch, Rowohlt, and Droemer Knaur.

We are an Equal Opportunity Employer. We are actively seeking job applicants who reflect a broad representation of differences, including race, ethnicity, religion, sex, sexual orientation, gender identity/expression, physical ability, neurodiversity, age, family status, economic background and status, geographical background and status, and perspective. We believe that the best companies reflect the incredible diversity in viewpoints, backgrounds, and identities of the world in their staffs, and are committed to inclusive hiring across departments and levels. The successful candidate for this position will be an employee of Macmillan Publishing Group, LLC.