Job details

Lead Data Engineer - R01548622

Get a free resume review

About Brillio:

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Lead Data Engineer

Primary Skills

Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front

Job requirements

Job Description: Below

About the Role

We're seeking a talented, creative, and motivated Senior Data Engineer who loves to build data platform tools and is ready to work with a team of individuals who share your passion. With a related degree under your belt--and relevant experience--you’re ready to take your programming and data knowledge to the next level. You enjoy building tools such as Data Ingestion Service to ingest data from diverse sources to Data Platform, building tools for monitoring & observability.  With your unwavering commitment to quality, excellent data/cloud skills, and collaborative work ethic, you’ll do great things.

What you’ll do:

You’ll work with other Data Engineers for the build-out of the Next Generation Data Platform. 
You’ll collaborate with various teams to provide guidance on best practices for utilizing the Cloud Data Platform.
You’ll be working on latest Cloud Data Warehouse Platform (Snowflake) and developing Data Marts using Python and SQL.  
You’ll work with the team to design and develop a Data Catalog Service using Snowflake Horizon and Polaris. 
You’ll work with the team to design and develop Data Observability using DataDog and Data Recon to detect data anomalies.
You will design and develop a CI/CD process for continuous delivery in AWS Cloud and Snowflake. 
You’ll design, develop, and test robust, scalable data platform components

  About you

The ideal candidate will possess extensive experience in building data platform at enterprise scale. You will possess strong analytical skills, attention to detail, and the ability to thrive in a fast-paced environment. Excellent communication and collaboration skills are essential to communicate with technical & non-technical partners. The candidate must demonstrate a proactive and results-driven approach to problem-solving, with a focus on driving continuous improvement and innovation in data quality and operational processes.
If you are eager to shape the next generation of data foundations in the real estate industry and make an impact, join us in an extraordinary world-class data and analytics organization and become part of the digital transformation is leading.

Your Experience

Bachelor’s in computer science, Engineering, or related technical discipline or equivalent combination of training and experience
5+ years programming experience: building application frameworks, and back-end systems for high-volume pipelines using Python.
Strong knowledge of SQL for querying, data manipulation, and data transformation
Understanding of dimensional modeling, star schemas, and data partitioning techniques
2+ years’ experience with the Cloud Data warehousing services, including storage options, compute capabilities, and data management tools
3+ years’ experience using Orchestration tools like Airflow or dbt
2 years’ experience using AWS Data Services: S3, Cloudformation, EMR
2 years’ experience building Data Observability tools like DataDog or any other tool .
3+ year exp. with data architecture, ETL and processing of structured and unstructured data
3+ years’ experience with DevOps tools (any combination of GitHub, TravisCI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)

Behavioral Competences

Excellent communication ability to communicate on different levels of seniority.
Team player; enjoying being part of a cross-functional setup.
Ability to perform well on time-critical endeavors and on multiple fronts at the time.
Strong dedication to quality and a 'client' mindset.
A passion for learning and continuous improvement.

Know more about:

DAI: https://www.brillio.com/services-data-analytics/

Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/

Equal Employment Opportunity Declaration

Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

#LI-SR1

$60 - $65 an hour

Know what it’s like to work and grow at Brillio: Click here

Average salary estimate

$130000 / YEARLY (est.)

min

max

$124800K

$135200K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Lead Data Engineer - R01548622, Brillio

Brillio is on the lookout for an inventive and enthusiastic Lead Data Engineer to join our dynamic team in Jersey City, New Jersey. If you're passionate about transforming data into actionable insights and thrive in a collaborative environment, this is the perfect opportunity for you! In this role, you’ll be instrumental in building our Next Generation Data Platform, working closely with skilled data professionals to implement best practices and cutting-edge technology. Your day-to-day tasks will include designing robust data systems, developing data catalog services, and ensuring data quality through observability tools. You'll get to roll up your sleeves and dive deep into SQL, Python, and AWS services while mentoring other engineers along the way. At Brillio, we pride ourselves on nurturing a culture of innovation, dedication, and continuous learning. With over 5 years of experience and a solid grasp of data engineering principles, coupled with a degree in computer science or a related field, you'll be well-prepared to make an impact in our fast-paced environment. This is not just a job; it’s a chance to play a pivotal role in shaping the future of data in the real estate industry and beyond. Join us, and become part of our extraordinary journey in digital transformation as we redefine what’s possible with data.

Frequently Asked Questions (FAQs) for Lead Data Engineer - R01548622 Role at Brillio

What does a Lead Data Engineer at Brillio do?

As a Lead Data Engineer at Brillio, your primary role involves designing and building the Next Generation Data Platform. You'll collaborate with various teams to create robust data systems, develop tools for data ingestion and observability, and optimize data warehouses. Your expertise in SQL, Python, and AWS will be vital in deploying high-quality data solutions to meet business needs.