Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Lead Data Engineer image - Rise Careers
Job details

Lead Data Engineer

⭐️⭐️ NEWLY CREATED ROLE !! ⭐️⭐️

Who are we?

So you might ask, who's CreditorWatch? Well, we are a leading Australian data and technology company that provides businesses with access to unique data and innovative products. By using our platform, our customers can confidently manage their commercial relationships, improve productivity and reduce financial risk.

As a commercial credit reporting bureau, we offer a complete suite of credit reporting products and data insights covering the entire customer lifecycle, from customer onboarding and credit decision automation to credit risk management and automated collections.

We were established in 2010 and most recently were named as one of AFR's Top 10 Best Places to Work as well as certified by Great Place to Work consecutively across 2022 and 2023.

We saw significant growth in 2024 and that's not about to change. We are on track to break records in 2025, scaling at pace, making this the perfect time to join CreditorWatch.

Our Purpose

✅ Empower Australian businesses to trade confidently with their customers.

Our Mission

🏆 We aim to be number one in our industry by delivering unique data insights and innovative products.

Your Role & Team

We are excited to launch a newly created role as a Lead Data Engineer.

In this role, you will lead a cross-functional team that designs and implements data-centric architectures within our applications.

Your focus will be to establish best practices for our data engineering function whilst being the technical manager of our Commercial Data as a business asset.

You'll provide people leadership, technical direction and architectural guidance while maintaining hands-on involvement in critical technical decisions and implementations.

Please note, our data engineering team are building customer facing products using data native technologies - this isn't an internal analytics focused function.

This role reports directly to the Head of Data and is a full-time opportunity offering hybrid working conditions based out of our Sydney CBD office.

Responsibilities

What your team is collectively responsible for delivering:

  • Design and implement data pipelines and models to support customer-facing applications and rapid product iteration.
  • Deliver data to product applications via API, files and tables with a focus on performance and scalability.
  • Source and ingest data from internal and external applications via database transfer, API, and other mechanisms.
  • Implement data technology, governance, and stewardship of our Commercial Data.
  • Build and maintain ML architectures and technology for Data Scientists that support both batch and real-time inference.
  • Drive technical excellence and innovation within the data domain.

What you as the Lead will be responsible for:

  • Provide technical leadership to ensure the team delivers on its purpose and impact.
  • Develop and grow the individuals within the team and their careers.
  • Architect and oversee software and data architectures that align with product needs and technology strategy.
  • Establish data modelling standards and best practices for consistency and quality.
  • Set direction for data processing frameworks, ETL processes, and data pipelines.
  • Collaborate with software engineering leads on API strategies and cross-functional initiatives.
  • Define data security, governance, and compliance frameworks.
  • Drive database performance optimisation and caching strategies.
  • Foster a culture of technical excellence, innovation, and continuous learning.
  • Lead the team in agile development processes.
  • Communicate complex data concepts to technical and non-technical stakeholders.
  • Evaluate emerging technologies and develop implementation roadmaps.

Our ideal candidate

Technical:

  • Data modelling, schema design, and data storage technologies
  • Data warehousing, data lakes, and data integration patterns
  • Data processing frameworks, both batch and real time
  • SQL and Python for data manipulation and transformation
  • RESTful principles and API design concepts
  • Data security best practices and access control mechanisms
  • Data governance principles, including data quality, data lineage, and data privacy regulations
  • Database performance optimisation techniques
  • Agile development methodologies
  • Continuous integration and deployment practices

People & Team:

  • Ability to identify resourcing requirements and build teams to fulfil outcomes
  • Team workflows and rituals
  • Team development journey
  • Feedback practices and strategies
  • Ability to lead and mentor team members

Skills:

  • Strong problem-solving and analytical skills
  • Proficiency in data processing languages (e.g., SQL, Python)
  • Expertise in at least one software language (e.g. Python)
  • Expertise in designing and implementing data architectures
  • Ability to develop efficient data processing frameworks and pipelines for batch and real time requirements
  • Familiarity with API integration and data service delivery
  • Knowledge of database performance optimisation and data caching
  • Experience with data security and governance practices
  • Excellent communication and collaboration skills
  • Proficiency in version control systems (e.g., Git)

More than just work

🏃🏽‍♀️ Keep Active – All employees get a Fitness First Platinum gym membership.

☕️ Daily Fuel – Barista-made coffee, breakfast, snacks, lunches and drinks on us – we got you!

📲 Phone Credits - We pay you $50 per month to put towards your plans - how good.

❤️‍🩹 Wellness Days – Receive an additional day off each month. Whether you’re pursuing physical activities, cultivating your mental wellbeing or supporting your community… this is your time to switch off from work.

💆🏽‍♂️ Monthly Massages – We offer monthly in-house massages to soothe those sore spots and tight knots. Poor posture? Stressful week? We get it.

💰 Bonus Shares – We offer our dedicated employees’ performance-based bonuses. Our employees are also permitted to gain access to our bespoke Employee Share Scheme, giving you the rare opportunity to invest in a growing technology company.

🤩 Fun Activities – We love escaping the workplace to do fun stuff. Whether its pasta-making, sailing classes, touch footy, winery tours, go karting or relaxing on the company boat (yeah… we own a boat) – these monthly team building activities will keep you feeling valued and connected.

👩🏻‍⚖️ Legal Services – Our employees get access to free legal services – from conveyancing and property advice to legal assistance around wills, trusts, powers of attorney and more. We make life easier for you, saving you time, money and unnecessary headaches.

Our Values

⚡️ The 1%’ers add up – Our commitment to going that one step further sets us apart, as we believe that small efforts or improvements in any aspect of our work collectively lead to significant success.

👊🏼 We are dependable and trustworthy – Our clients are everything to us and we are passionate about maintaining and delivering reliable and trusted services to them.

📈 We are committed to growth – Our success comes from our ability to grow and adapt; both collectively and individually. We set the bar high to ensure we continue to innovate and exceed expectations. We are dedicated to the development of our business and our people.

🫶🏾 Our people make the difference – Just as we help small businesses think big, we help our employees achieve their aspirations. We provide our people with challenges and opportunities, supporting them to live their best lives.

Recruitment Process – We like to keep it simple!

  1. Phone Screening – A deep dive into the company, role and experience required, including a thorough review of your match to the role – let’s get to know each other and ensure the opportunity is a match!
  2. Short Coding assessment - To understand your technical ability and will be used in the next Technical stage.
  3. Technical Interview  – to understand if there is a technical fit from both sides.
  4. Values Meeting – We’d love to hear why CreditorWatch and see how you’d fit into our world.

We are committed to you

We offer a fantastic culture with open communication and rewards and recognition that include probation celebrations, all-staff birthday and service anniversary celebrations.

We are an equal opportunity employer and committed to excellence through diversity. We do not discriminate on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

We are a 2024 Circle Back Initiative Employer – we commit to respond to every applicant.

CreditorWatch Glassdoor Company Review
4.2 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
CreditorWatch DE&I Review
4.4 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
CEO of CreditorWatch
CreditorWatch CEO photo
Unknown name
Approve of CEO

Average salary estimate

$135000 / YEARLY (est.)
min
max
$120000K
$150000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Lead Data Engineer, CreditorWatch

Are you ready to step into an exciting leadership role with CreditorWatch as our new Lead Data Engineer? At CreditorWatch, we pride ourselves on being a cutting-edge Australian data and technology company, dedicated to empowering businesses with innovative and unique data insights. As our Lead Data Engineer, you will spearhead a cross-functional team focused on designing and implementing data-centric architectures that drive our customer-facing applications. This is not just another data engineering role; you will play a pivotal part in shaping the future of our Commercial Data. Your responsibilities will include establishing best practices for data engineering while maintaining hands-on involvement in critical technical decisions. You’ll guide our team in building and optimizing data pipelines, driving technical excellence, and fostering innovation across all projects. In addition, you’ll communicate complex data concepts clearly to both technical and non-technical stakeholders, ensuring everyone is aligned and moving towards our mission to deliver exceptional data products. We’ve built a fantastic culture at CreditorWatch, earning recognition as one of AFR's Top 10 Best Places to Work. With hybrid working options and growth opportunities, now is the perfect time to join our winning team. Ready to make an impact and grow with us? We’d love to hear from you!

Frequently Asked Questions (FAQs) for Lead Data Engineer Role at CreditorWatch
What are the key responsibilities of the Lead Data Engineer at CreditorWatch?

As the Lead Data Engineer at CreditorWatch, you will design and implement robust data pipelines and models, ensuring seamless integration with our customer-facing applications. Additional responsibilities include driving technical excellence, mentoring team members, and overseeing the architecture of software and data frameworks that align with our product and technology strategies.

Join Rise to see the full answer
What qualifications do I need for the Lead Data Engineer role at CreditorWatch?

To excel as the Lead Data Engineer at CreditorWatch, candidates should have strong experience in data modeling, schema design, and data storage technologies. Proficiency in Python and SQL is essential, along with a solid understanding of data governance principles and agile development methodologies.

Join Rise to see the full answer
How does CreditorWatch support professional growth for a Lead Data Engineer?

At CreditorWatch, we are committed to the growth of our employees, especially in roles like the Lead Data Engineer. You will have ample opportunities to develop your technical and leadership skills, participate in continuous learning initiatives, and contribute to innovative projects that shape our data strategies.

Join Rise to see the full answer
What kind of work culture can a Lead Data Engineer expect at CreditorWatch?

The work culture at CreditorWatch is built on collaboration, innovation, and fun! As a Lead Data Engineer, you’ll be part of a supportive team environment that values open communication, celebrates achievements, and encourages professional development while enjoying a range of employee benefits.

Join Rise to see the full answer
What tools and technologies should a Lead Data Engineer at CreditorWatch be familiar with?

Candidates applying for the Lead Data Engineer role at CreditorWatch should be familiar with a variety of tools and technologies, including data processing frameworks, data warehousing solutions, API design concepts, and database optimization techniques. Experience with ML architectures and data security best practices will also be beneficial.

Join Rise to see the full answer
Common Interview Questions for Lead Data Engineer
Can you explain your experience with designing data architectures as a Lead Data Engineer?

When answering this question, discuss specific projects where you implemented data solutions. Describe the challenges faced, your approach to designing scalable data architectures, and the technologies used. Highlight how your contributions impacted the organization positively.

Join Rise to see the full answer
How do you ensure data security and governance in your engineering practices?

Show that you understand the importance of data security. Discuss your experience in implementing access control mechanisms, conducting regular audits for data privacy, and adhering to regulatory standards to ensure the security of sensitive information.

Join Rise to see the full answer
What techniques do you use for performance optimization in databases?

Provide examples of strategies you’ve employed for optimizing database performance, such as indexing, database tuning, and caching strategies. Explain why these techniques were chosen and their impact on system efficiency.

Join Rise to see the full answer
Describe your experience with agile development methodologies.

Share how you’ve successfully led teams through agile practices. Discuss the benefits of agile in your previous projects and how these methodologies fostered collaboration and rapid product iterations.

Join Rise to see the full answer
What is your approach to mentoring junior data engineers?

Highlight your philosophy on mentoring, focusing on building strong relationships, providing constructive feedback, and enabling team members to take on challenging projects while supporting their professional growth.

Join Rise to see the full answer
Can you discuss a time when you had to make a critical technical decision?

Provide a specific instance where your decision-making had a significant impact. Discuss the factors considered, the decision-making process, and how it ultimately benefited the project or team.

Join Rise to see the full answer
How do you handle tight deadlines when working on data projects?

Explain your strategies for managing time and resources effectively under pressure. Discuss how prioritization, delegation, and maintaining open communication can lead to successful project delivery without compromising quality.

Join Rise to see the full answer
What role does collaboration play in data engineering?

Emphasize the importance of working with cross-functional teams in your role. Discuss how collaboration adds value to projects, facilitates knowledge sharing, and fosters innovation through diverse perspectives.

Join Rise to see the full answer
How do you stay updated on emerging data technologies?

Share your approach to continuous learning, such as following industry blogs, attending conferences, or joining professional networks. Highlight a few recent technologies you've explored and their potential applications.

Join Rise to see the full answer
Why do you want to work as a Lead Data Engineer at CreditorWatch?

Articulate your motivations for applying, such as admiration for CreditorWatch’s mission, innovative projects, and focus on empowering businesses. Connect your career goals with the opportunities available at CreditorWatch.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Posted 5 days ago

CreditorWatch is looking for a Marketing Automation Manager to lead data-driven marketing efforts and optimize customer engagement strategies.

Photo of the Rise User
CreditorWatch Remote No location specified
Posted 8 days ago

Join CreditorWatch as a Senior Product Designer and help redefine customer experiences with innovative data and technology solutions.

Photo of the Rise User
Principal Financial Group Remote Des Moines, Iowa, United States
Posted 7 days ago

Join Principal's Private Market Data Engineering Team as a Senior Data Engineer, where you'll impact financial tools by optimizing data processes and analytics.

Posted 11 days ago

Join Sayari as a Data Engineer to help build and maintain essential ETL pipelines and contribute to innovative data-driven solutions.

Photo of the Rise User
American Express Remote Phoenix, Arizona, United States
Posted 4 days ago
Inclusive & Diverse
Empathetic
Collaboration over Competition
Growth & Learning
Transparent & Candid
Medical Insurance
Dental Insurance
Mental Health Resources
Life insurance
Disability Insurance
Child Care stipend
Employee Resource Groups
Learning & Development

Join American Express as a Senior Data Engineer and shape the future of data-driven business solutions in a collaborative and innovative environment.

Photo of the Rise User
Workato Hybrid Palo Alto, California, United States
Posted 8 days ago
Customer-Centric
Collaboration over Competition
Fast-Paced
Empathetic

Join Workato as a Data Engineer to leverage your expertise in data pipelines and analytics to shape the future of enterprise operations.

Photo of the Rise User
Posted yesterday

Join ELEKS as a Senior Data Engineer and play a crucial role in optimizing data solutions for a prestigious global law firm.

Photo of the Rise User
Posted 19 hours ago

Join Leidos as a Data Operations Engineer and play a pivotal role in creating and maintaining data pipelines for optimal data utilization in a fully remote capacity.

Photo of the Rise User
Rockwell Automation Remote Medellin, Antioquia, Colombia
Posted 6 days ago

Join Rockwell Automation as a Data Engineer and contribute to groundbreaking projects that redefine the manufacturing landscape.

Photo of the Rise User

Join Visa as a Data Engineer and tackle large-scale data challenges to enhance employee experiences through advanced analytics.

MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
April 8, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
G
Someone from OH, Cincinnati just viewed Operations Lead - AML Refresh Ops (Global Banking) at GHR
Photo of the Rise User
Someone from OH, Akron just viewed Data Scientist II at Kaiser Permanente
Photo of the Rise User
Someone from OH, Eastlake just viewed Summer Intern at Gooch & Housego
I
Someone from OH, Perrysburg just viewed CNC Manufacturing Technician at Innovance
Photo of the Rise User
Someone from OH, Cincinnati just viewed Senior Lifecycle Marketing Manager at SoFi
Photo of the Rise User
Someone from OH, Cincinnati just viewed Lifecycle Marketing Manager at Caribou
Photo of the Rise User
Someone from OH, Cincinnati just viewed Senior Marketing Manager at Ocorian
Photo of the Rise User
Someone from OH, Cincinnati just viewed Growth Marketing Manager at Credit Genie
Photo of the Rise User
Someone from OH, Cincinnati just viewed Director of Product Marketing - AAA Campaigns at PrizePicks
Photo of the Rise User
Someone from OH, Cincinnati just viewed Digital Marketing Analyst, Digital Properties at Darden
Photo of the Rise User
Someone from OH, Cincinnati just viewed Growth Lead at io.net
Photo of the Rise User
Someone from OH, Cincinnati just viewed Sr. Manager / Director of Demand Generation at Seesaw
Photo of the Rise User
Someone from OH, Euclid just viewed Work From Home Union Benefits Rep at Global Elite
Photo of the Rise User
Someone from OH, Cincinnati just viewed Runtime QA Tester II at Aechelon Technology