Staff Data Engineer

About usAt National Grid, we keep people connected and society moving. But it's so much more than that. National Grid supplies us with the environment to make it happen. As we generate momentum in the energy transition for all, we don't plan on leaving any of our customers in the dark. So, join us as a Lead Network Security Operations Center Engineer, and find your superpower.We need you!We want to find an innovative, adaptable, and results-oriented Staff Data Engineer for our Product Engineering department. This position can be located in Waltham, MA, Brooklyn, NY, Hicksville, NY, or Syracuse, NY (candidates may also reside in either Connecticut, New Jersey, New Hampshire, Pennsylvania, Rhode Island, Vermont, or Maine). If you yearn to be innovative, contribute new ideas, and play a critical part in our US IT Electric business unit, we want to hear from you!What you'll doAs a Staff Data Engineer, you'll be part of a Data Engineering team that is focused on making critical data at National Grid available to our business teams. Using the agile framework, you'll build end-to-end pipelines based on rigorous engineering standards and coding practices to deliver data that is accessible and of the highest quality. You'll also contribute to the modernization of our architecture and tools to help increase our output, scalability, and speed. You'll design and develop highly scalable and extensible data pipelines which enable collection, storage, distribution, modeling, and analysis of large data sets from many channels. Key responsibilities include the following:• Lead the Data engineering Team to Develop, test, document and support scalable data pipelines.• Build out new data integrations including APIs to support continuing increases in data volume and complexity.• Build and implement scalable solutions that align to our data governance standards and architectural road maps for data integrations, data storage, reporting, and analytic solutions.• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.• Design and develop data integrations and a data quality framework. Write unit/integration/functional tests and document work.• Design, implement, and automate deployment of our distributed system for collecting and processing streaming events from multiple sources• Perform data analysis needed to troubleshoot data-related issues and aid in the resolution of data issues.• Guide and mentor junior engineers on coding best practices and optimization.About you• Education: 4-year college degree or equivalent combination of education and experiencein Computer Science, Mathematics, Statistics, or related technical field.• 8 years of relevant work experience in analytics, data engineering, business intelligence or related field.• Skilled in object-oriented programming (Python in particular).• Strong Experience in Python, PySpark and SQL.• Strong Experience in Databricks & Snowflake.• Experience developing integrations across multiple systems and APIs.• Experience with or knowledge of Agile software development methodologies.• Experience with cloud-based databases, specifically Azure technologies (e.g., Azure data lake, ADF, Azure DevOps and Azure Functions).• Experience using SQL queries as well as writing and perfecting SQL queries in a business environment with large-scale, complex datasets.• Experience with data warehouse technologies.• Experience creating ETL and/or ELT jobs.More InformationAre you the right fit for this exciting role? You want to learn more about the position and National Grid's ambitious Digital Transformation? Then let's chat!Rewarding work and a collaborative, team-oriented culture are just the beginning. Review our digital benefit guide at negbenefitslivebrighter.com for full details and descriptions.Our organization follows a hybrid work structure in our service territory (NY & MA and adjacent states) where employees can work remotely or from the office, as needed. Working from the office is encouraged when working on tasks that require a high degree of collaboration. We work with our employees to foster a flexible work schedule.#LI-CL1 #LI-HYBRIDSalaryDowstate NY $152,000 - $179,000 a yearMassachusetts $142,000 - $167,000 a yearUpstate NY$127,000 - $149,000 a yearSalary is commensurate with experience and locationThis position has a career path which provides for advancement opportunities within and across bands as you develop and evolve in the position; gaining experience, expertise and acquiring and applying technical skills. Candidates will be assessed and provided offers against the minimum qualifications of this role and their individual experience.National Grid is an equal opportunity employer that values a broad diversity of talent, knowledge, experience and expertise. We foster a culture of inclusion that drives employee engagement to deliver superior performance to the communities we serve. National Grid is proud to be an affirmative action employer. We encourage minorities, women, individuals with disabilities and protected veterans to join the National Grid team.