Data Engineer

Skills

• Extensive experience in cloud architecture and data engineering
• Expertise in integrating, transforming, and consolidating data
• Knowledge of SQL, Python, or Spark
• Experience in building secure data processing pipelines
• Strong critical thinking and attention to detail

Responsibilities

• Build complex data solutions in an Azure Cloud environment
• Maintain Azure components and services
• Develop architecture changes using infrastructure as code
• Create data architectures diagrams for complex data modeling solutions
• Create and maintain data dictionaries for contextualizing data from disparate sources
• Enable end-to-end automation for deployment using continuous integration and continuous delivery
• Implement data pipelines to ingest, standardize, and transform data
• Perform unit and integration testing of data pipelines
• Work with BI developers and business SMEs to translate business requirements into curated datasets

Education

• Bachelor’s degree in Computer Science, Data Analytics, Engineering, Mathematics, Business, or related field

Benefits