Data Engineer

Job DescriptionWelcome to the intersection of energy and home services. At NRG, we’re driven by the idea of a smarter, cleaner, more connected future—and the possibilities that will bring to the world and to the 7.3 million customers we serve.Vivint Smart Home, an NRG owned company, is a leading smart home company in the United States, dedicated to redefining the home experience with intelligent products and services. We find purpose in proactively protecting and keeping our customers connected to home, no matter where they are. Join the Smart Home team to create smarter, safer and more sustainable homes. More information is available at www.nrg.com or www.vivint.com. Connect with NRG and Vivint on Facebook, Instagram, LinkedIn and X.SummaryIn this role, you will help drive Vivint's data platform. You will work with a talented team of data scientists and engineers to provide insights across the organization. As a Data Engineer, you will be instrumental in designing, building, and maintaining robust datasets and ETL (Extract, Transform, Load) pipelines that process and integrate large volumes of IoT (Internet of Things) data. Your work will empower business users by delivering high-quality, actionable insights and facilitating data-driven decision-making across the organization.Primary Responsibilities• Design and Develop ETL Pipelines: Architect, implement, and optimize ETL processes to handle the ingestion, transformation, and storage of large-scale IoT data streams. Ensure data accuracy, consistency, and availability for analysis.• Create and Maintain Datasets: Develop and manage comprehensive datasets that aggregate IoT data from various sources. Ensure datasets are well-structured, accessible, and aligned with business needs.• Data Integration and Optimization: Integrate disparate data sources and optimize data storage and retrieval processes to support efficient querying and reporting. Implement best practices for data quality and performance.• Collaborate with Stakeholders: Work closely with business users, data scientists, and analysts to understand data requirements and translate them into technical solutions. Provide support and troubleshooting for data-related issues.• Monitor and Improve Data Systems: Continuously monitor the performance of data pipelines and datasets. Identify and address potential issues, and implement improvements to enhance efficiency and reliability.• Documentation and Compliance: Document data processes, pipeline architectures, and system changes. Ensure compliance with data governance and security policies.Required Skills• Minimum of 4 years of professional experience in data analysis or data engineering• Experience with Big Data/Hadoop applications.• Experience with Spark, Hive, Kafka, and Map Reduce• SQL experience and strong background in optimizing SQL queries for transforming data• Experience with different data formats (Parquet, Arvo, Json, XML, etc.)• Experience bringing in data from multiple Data Sources / API’s• Building and Debugging Data Pipelines• Distributed systems (pipelines and databases)• Proficient in Python development for data pipelines and automation, including debugging, testing, and handling development. At least 2 years experience preferred.• Experience in Linux environments, batch automation, and shell scriptsNice To Have• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Redshift, Snowflake)Required Education/Experience• Graduate Degree in a Quantitative field (Math, Statistics, Engineering, Computer Science) or relevant experience.• 3+ years work experience. Here are some highlighted perks you should ask us about:• Free daily lunch and drinks on site• Paid holidays and flexible paid time away• Employee/Friends/Family Discounts• Onsite health clinic, gym, gaming tables• Medical/dental/vision/life coverage & 24/7 Medical Hotline• 401(k) + Employer Match• Employee Resource GroupsWorking ConditionsThis job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.SafetyWe enforce a safety culture whereby all employees have the responsibility for continuously developing and maintaining a safe working environment. Each new employee is responsible for completing all training requirements. Additionally, the employee must accept they have responsibility for maintaining the safety of themselves, their co-workers, and the public. Employee must adhere to all written and verbal instructions, promptly report and correct all hazards or unsafe conditions, question non-standard operations or unmitigated hazards, and provide feedback to management on all safety issues.If you are an active Vivint employee, please apply through Workday by searching "Find Jobs".If you are an active Vivint employee, please apply through Workday by searching "Find Jobs".