Data Engineer

Global technology consultancy BBGC are looking for a UK-based data engineer to join our team.

About BBGC

We are a global technology consultancy firm with offices in Middle East, Asia, Europe and USA. We deliver business benefits through innovation. We leverage cutting-edge technology led solutions delivered by a team of skilled professionals, from sustainable software development to cloud services and operational excellence strategy. We have extensive expertise in Capital Markets and in particular Trading and Risk Management functions.

We are looking for a data engineer with technical abilities in data modelling, transformation and visualisation with proficient skills on data processing technologies and methods. Ideally people will possess experience in event-driven architecture and analytics modelling using Python and have experience with Tableau/Power BI

A significant aspect of this role includes engaging directly with business stakeholders and senior management to assess their requirements, suggest outcomes, and translate business objectives into effective data visualisation solutions while optimising the underlying data architecture.

Main responsibilities

• Create data pipelines that combine internal and external data, across several APIs and databases (relational and non-relational) preparing and refining data for analysis.

• Ensure accuracy and integrity of data at all times. This includes testing and validating data pipelines.
• Data Analysis, Visualisation and Dashboards: Creating clear, compelling, and accurate visualisations and dashboards that make complex data easily understandable.
• Database Architecture and Optimisation: Developing database structures that are both efficient and scalable,
• Engaging with business stakeholders to assess their requirements, suggest outcomes, and translate business objectives into effective data visualisation solutions.

Experience and technical requirements

• Python and SQL coding experience
• Proficiency with Git and CI/CD (ideally using Azure DevOps)
• Experience with scripting languages (Bash, shell scripting),
• Proficiency on ETL processes and data modelling
• Proficiency in visualisation tools such as Tableau and Power BI.
• Skilled with relational databases (SQL Server, Oracle or PostgreSQL).

Person Specification:

• Strong communication skills, written and verbal
• Effective problem-solving and critical-thinking abilities to tackle data-related challenges.
• Able to multitask, switch focus and prioritise tasks
• Can take ownership of any issues that come up and facilitates their resolution quickly using their own initiative

Beneficial Requirements:

• Experience with Docker and containers desirable
• Broad experience with cloud computing (e.g. Microsoft Azure or AWS) beneficial
• Experience of working in the utilities, energy (or similar) market or prior knowledge of a  trading environment