Lead Product Software Engineer - Lead Cloud Data Engineer

The Lead Cloud Data Engineer in Tax and Accounting innovative and fast-growing Global Audit team is responsible for designing, implementing end to end solutions in Azure Enterprise Data Lake and optimizing data pipelines, ensuring the availability, performance, scalability and security of large-scale data processing systems. This role requires deep understanding of big data technologies, data architecture, infrastructure, CI/CD and data engineering best practices. Experience with Unity Catalog is a bonus. The Lead Cloud Data Engineer will work closely with architects, leads and other stakeholders to support data driven decision making processes.Experience Required• Minimum 8+ years of experience with 3+ years as a Lead Data Engineer or related role• 5+ years of demonstrated experience in developing Big Data solutions that support business analytics and data science teams• 3-5 years of proficient Data ingestion end-to-end implementation of projects in Azure Enterprise Data Lake, Azure Functions, Databricks, Blob Storage, Cosmos DB, Azure stream analytics, Python, SQL• Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog• Good understanding of spark architecture with Databricks structured streaming, setting up Azure with Databricks, managing clusters in Databricks• Experienced in DevOps and deployment automations with Azure DevOps - ARM, YAML, Terraform• Strong knowledge and hands-on experience in SQL, Unix shell scripting• Ability to research latest trends and propose advanced tooling/solutions for Cloud Data Lake & Data Science platforms• Experience with business intelligence and analytics tools such as OBIEE, PowerBI or Tableau• Experience with Unity Catalog preferred• Collaborate applications teams/Business users to develop new pipelines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc• Ensure data security and compliance.Roles & Responsibilities• Lead and implement design of data schemas, drive cloud data lake platform design decisions and development standards and maintain data pipelines for data ingestion, processing, and transformation in Azure• Extract, transform and load from sources system to Azure Data Storage services using a combination of Azure Data factory, Azure Blob Storage, T-SQL, Pyspark and Azure Databricks• Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions• Integrate data from various sources, ensuring data quality, consistency and reliability.• Define data requirements, gather and mine large scale structured and unstructured data, and validate data using various tools in a cloud environment.• Manage and optimize Azure Enterprise data Lake for efficient data storge and processing.• Develop and optimize ETL processes using Databricks and related tools like Apache Spark• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.Benefits:A comprehensive benefits package that begins your first day of employment. Additional Information: Wolters Kluwer offers great benefits and programs to help meet your needs and balance your work and personal life, including Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available - https://www.mywolterskluwerbenefits.com/index.htmlDiversity MattersWolters Kluwer strives for an inclusive company culture in which we attract, develop, and retain diverse talent to achieve our strategy. As a global company, having a diverse workforce is of the utmost importance. We've been recognized by employees as a European Diversity Leader in the Financial Times, as one of Forbes America’s Best Employers for Diversity in 2022, 2021 and 2020 and as one of Forbes America’s Best Employers for Women in 2021, 2020, 2019 and 2018. In 2020, we placed third in the Female Board Index, and were recognized by the European Women on Boards Gender Diversity Index. Wolters Kluwer and all of our subsidiaries, divisions and customer/departments is an Equal Opportunity / Affirmative Action employer.