Job details

AWS Data Engineer - Fully Remote - US Only

❋ Why Scalepex?

Scalepex is a dynamic services firm specializing in providing solutions for premium brands like Nike, Pepsi, Toyota, Virgin and Walgreens. Our mission is to connect prominent market leaders with top-tier professionals from around the world, fostering collaboration, efficiency, and growth.

❋ Take your portfolio to the next level by working with one of our fastest growing clients.

Join the Innovation Frontier at Scalepex!

About the Role

We are seeking an experienced AWS Data Engineer with a strong background in building scalable data solutions and expertise in utilities-related datasets. The ideal candidate will have at least 5 years of experience in data engineering, a deep understanding of distributed systems, and proficiency with AWS services and tools like Step Functions, Lambda, Glue, and Redshift. This role will focus on designing, developing, and optimizing data pipelines to support analytics and decision-making in the utilities industry.

Key Responsibilities

Design and Build Data Pipelines: Develop scalable, reliable data pipelines using AWS services (e.g., Glue, S3, Redshift) to process and transform large datasets from utility systems like smart meters or energy grids.
Workflow Orchestration: Use AWS Step Functions to orchestrate workflows across data pipelines; experience with Airflow is acceptable but Step Functions is preferred.
Data Integration and Transformation: Implement ETL/ELT processes using PySpark, Python, and Pandas to clean, transform, and integrate data from multiple sources into unified datasets.
Distributed Systems Expertise: Leverage experience with complex distributed systems to ensure reliability, scalability, and performance in handling large-scale utility data.
Serverless Application Development: Use AWS Lambda functions to build serverless solutions for automating data processing tasks.
Data Modeling for Analytics: Design data models tailored for utilities use cases (e.g., energy consumption forecasting) to enable advanced analytics
Optimize Data Pipelines: Continuously monitor and improve the performance of data pipelines to reduce latency, enhance throughput, and ensure high availability.
Ensure Data Security and Compliance: Implement robust security measures to protect sensitive utility data and ensure compliance with industry regulations.

Required Qualifications

Minimum of 5 years of experience in data engineering
Proficiency in AWS services such as Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift.
Strong programming skills in Python with experience using PySpark and Pandas for large-scale data processing.
Hands-on experience with distributed systems and scalable architectures.
Knowledge of ETL/ELT processes for integrating diverse datasets into centralized systems.
Familiarity with utilities-specific datasets (e.g., smart meters, energy grids) is highly desirable.
Strong analytical skills with the ability to work on unstructured datasets.
Knowledge of data governance practices to ensure accuracy, consistency, and security of data.

Strong experience in AWS data engineering
Ability to work independently
Ability to work with a cross-functional teams, including interfacing and communicating with business stakeholders
Professional oral and written communication skills
Strong problem solving and troubleshooting skills with experience exercising mature judgement
Excellent teamwork and interpersonal skills
Ability to obtain and maintain the required clearance for this role

Average salary estimate

$110000 / YEARLY (est.)

min

max

$90000K

$130000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About AWS Data Engineer - Fully Remote - US Only, Scalepex

If you're ready to take your career up a notch, Scalepex has the perfect opportunity for you! We are on the hunt for an AWS Data Engineer who is eager to dive into the dynamic world of data solutions, particularly in the utilities sector. At Scalepex, we pride ourselves on our innovative approach, collaborating with top brands like Nike and Toyota. As an AWS Data Engineer, you'll bring at least 5 years of experience and a solid understanding of distributed systems to the table. Your main focus will be on designing, developing, and optimizing robust data pipelines that support critical analytics in the utilities industry. Imagine architecting scalable data solutions using tools from the AWS suite, such as Glue, Step Functions, Lambda, and Redshift. You’ll be responsible for creating data models that enhance analytics, implementing ETL processes, and ensuring that sensitive utility data is secure and compliant. This position allows you to get your hands dirty with cutting-edge technology, while also providing you the autonomy to work independently and with cross-functional teams. It’s not just about the tech; strong communication and problem-solving skills are crucial to connect with stakeholders and ensure that we’re delivering the best possible solutions. Join Scalepex and be part of a team that values innovation and professional growth!

Frequently Asked Questions (FAQs) for AWS Data Engineer - Fully Remote - US Only Role at Scalepex

What skills are essential for the AWS Data Engineer position at Scalepex?

For the AWS Data Engineer role at Scalepex, it’s crucial to have at least 5 years of experience focused on data engineering. Proficiency in AWS services like Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift is necessary. Additionally, strong programming skills in Python, specifically using PySpark and Pandas for processing large datasets, will help you excel in this position. Familiarity with distributed systems and utilities datasets, such as smart meters and energy grids, will also be beneficial.