Data Engineer

As a Data Engineer at iKnowHow Group, you will primarily focus on designing and implementing data solutions, ensuring optimal extraction, transformation, and loading of data from various sources using SQL and Azure technologies. Your role will include developing and maintaining ETL pipelines, creating efficient data architectures, and streamlining internal processes to enhance data delivery.

To qualify for the Data Engineer role at iKnowHow Group, candidates should possess a Bachelor's degree in Computer Science or a related field and have at least three years of experience in application development with relational databases and Apache Spark. Experience with Python programming and knowledge of machine learning concepts are also essential.

A Data Engineer at iKnowHow Group will work with a variety of technologies, including SQL, Azure technologies, Apache Spark, and programming in Python. Familiarity with data integration systems like Azure Data Factory and CI/CD tools such as Jenkins or Azure DevOps will also be beneficial in this role.

At iKnowHow Group, Data Engineers can look forward to extensive career development and growth opportunities. The company prioritizes continuous learning through personalized seminars and training, ensuring that you stay at the forefront of technology advancements in the Industry 4.0 era.

iKnowHow Group offers an attractive compensation package for Data Engineers, alongside benefits like a comprehensive medical plan, life insurance, and a vibrant open-office workspace in Athens. The company also emphasizes ongoing training and learning opportunities to foster professional growth.

When answering this question, provide specific examples of projects where you've utilized SQL for data extraction, transformation, or loading. Emphasize your ability to write complex queries and how you've resolved specific data-related challenges using SQL, showcasing your problem-solving skills.

Discuss specific ETL processes you've designed or modified, focusing on the tools and technologies you used, such as Azure or Apache Spark. Highlight any challenges you faced and your approach to overcoming them to streamline data workflows.

Mention your proficiency in programming languages like Python and how you’ve leveraged this knowledge in data processing or automating tasks. Providing concrete examples of code snippets or projects will help illustrate your technical abilities.

Share a specific example of a data issue, detailing your analytical approach to diagnosing the problem. Explain the steps you took to resolve the issue, including any tools or methodologies you employed.

Discuss your prior experience with data integration tools such as Azure Data Factory or Apache Airflow. Explain how these tools have improved your data workflows, focusing on efficiency gains and process automation.

Outline the specific techniques you use to maintain data quality, such as validation checks, regular audits, or data cleansing processes. Discuss any tools you prefer to use and why they are effective.

Explain your proactive approach towards ongoing learning, such as reading industry blogs, participating in online courses, or attending webinars. Highlight any recent advancements you have implemented or explored in your previous roles.

Share your experiences working within a team, emphasizing collaboration, communication, and the ways in which you contribute to achieving shared goals. Highlight the importance of sharing knowledge and supporting team members.

Detail a specific instance where you automated a manual process, the tools you used, and the impact it had on efficiency and productivity. Discuss any metric improvements that resulted from this automation.

Discuss your experience with big data frameworks like Apache Spark, outlining specific projects where you implemented these technologies. Highlight any performance improvements achieved through your efforts.