Data Engineer (Next Generation Data Platform)

You might already know us - we're the ones with the Meerkats! Compare the Market has helped revolutionise the insurance market and we have been growing rapidly since starting in 2006.

We are on a mission to transform the comparison industry, moving beyond endless forms and generic search results, to a highly personalised, service-led experience. In order to do so, we recognise that we need to consistently deliver seamless, personalised customer experiences through a connected data and technology ecosystem.

Your role will be pivotal in achieving this, by delivering and owning high performance data applications using cutting edge technology.

A little about the team

At CTM our Data Engineering team is at the heart of everything that we do. The team manages and works on multiple streams and projects that have a high impact and importance for the business. This role will sit within our Next Generation Data Platform (NGDP) team and focus on building the next generation data platform for CTM, acting as an enabler to build a more Unified Customer Vison. There’s no legacy code here, and as a Data Engineer in our team, you will be driving the development of quality solutions for our customers and be proactive in adopting and championing best practices.

You’ll make a real impact by taking an active role in the team’s agile practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data.

What we want to see from you:

• A passion for data. You don’t already need to be a data engineer, but as this role would involve building strong, robust pipelines to ingest data from a variety of sources with a focus on real-time streaming (we process millions of events a day and deal with 100 TBs of data here) we’d like to see a demonstrable interest in the data challenges we have.
• A willingness to come up with new ideas, experiment, fail, learn and develop - and share that knowledge with peers across the wider team
• Proven industry experience in a JVM language. We use Java for most of our services, but Scala and Python experience could also be valuable
• Experienced with one or two of the following: Kafka, Spark, AWS, Docker, Terraform, Kubernetes, stream processing technologies (e.g., Kinesis, Kafka Streams)
• Demonstrable experience in modern software engineering principles (Agile, CI/CD, TDD/BDD)
• Self-motivated and active learner, keeping up to date with industry knowledge and keen to learn new languages and tools
• Customer focused, you never lose sight of the big picture
• Great communicator, you're able to articulate your thoughts to the wider team and influence discussions
  

• Flexible working
• Hybrid working culture (mixture of remote and state of the art office spaces)
• Brilliant office space made for collaboration and agile working
• Competitive salaries based on experience, expertise and qualifications
• Bonus scheme
• Contributory pension scheme
• Wellbeing programme focused on physical, emotional and financial wellbeing
• Private health care
• Free fruit in our offices
• An onsite gym at our headquarters in Peterborough - and a gym discount scheme for those based in London
• Season ticket loan and cycle to work schemes
• Plus, loads more through our flexible benefits hub

• Telephone call
• Final Interview with case study/ tech test