Data Engineer 2 (Mailchimp)

Company Overview

Intuit is the global financial technology platform that powers prosperity for the people and communities we serve. With approximately 100 million customers worldwide using products such as TurboTax, Credit Karma, QuickBooks, and Mailchimp, we believe that everyone should have the opportunity to prosper. We never stop working to find new, innovative ways to make that possible.

Job Overview

As a part of the Observability Platforms team, you’ll join us in maintaining, scaling, optimizing, and migrating our Observability and data pipeline infrastructure. It consists of Kafka and PubSub, which pushes up to 10 billion events per day, and Splunk, Elasticsearch and OpenSearch clusters that ingest 1 trillion documents. We provide our internal and external customers with highly available, approachable data pipelines and discovery tools such as Wavefront, Splunk, and Grafana. Together with the rest of the Observability Platforms, we enable Mailchimp’s understanding of

business-critical processes and support the tools and features that Mailchimp’s customers use to find and fine-tune their audiences.

Qualifications

• Some experience writing APIs, tools, and scripts (Python, Golang, Bash or PHP)
• Some experience with cloud technologies (AWS, Google Cloud)
• Familiarity with other pieces of our technical stack (Kafka, PubSub, Kubernetes, Wavefront, Splunk, Prometheus, and PagerDuty)
• Experience with git or other version control tools
• Ability to utilize automation and orchestration tools to build large scalable systems
• Experience with Splunk, Wavefront, Grafana, and creating Dashboards and visualizations

Responsibilities

• Collaborate across teams to support the organization's data pipeline priorities
• Automate processes, create tools, and build features that will improve everyone's experience with our data pipeline infrastructure
• Guide engineers on how they can best utilize the data streaming platform to gain confidence that their services are performing as expected
• Develop, communicate, and enforce standards
• Participate in an on-call schedule, and assist in mitigating issues that may arise
• Troubleshoot and maintain existing infrastructure to ensure the smooth operation of data pipelines, observability tools and cloud platform
• Contribute to technical documentation of our infrastructure and systems
• Track work in assigned tickets and contribute to project planning