Data Engineer

AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas – immunology, oncology, neuroscience, and eye care – and products and services in our Allergan Aesthetics portfolio. For more information about AbbVie, please visit us at www.abbvie.com. Follow @abbvie on X, Facebook, Instagram, YouTube, LinkedIn and Tik Tok.

AbbVie Information Research is seeking a Data Engineer who would contribute to the architecture, design, and development of the Data & Analytics Platform supporting world-class research and development at AbbVie. As a Data Engineer, you will be a core member of a high-performance team of data engineers and architects focusing on driving technology innovation and continuous improvement. This role collaborates with solution architects, product owners, program managers, business analysts, infrastructure teams, and service providers to deliver the solutions. 

Requirements:

• Design and deliver various data engineering activities to enhance the data platform, including data warehousing, master data management, data cataloging, system integration, data streaming, data visualization, data analysis, and data ops.
• Building required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS, Cloudera, Spark, python, Modak Nabu, and SQL technologies
• Work with R&D/life science-centric datasets and utilize this knowledge to develop TL(Standard Datasets) and ATL (asset-specific datasets).
• Maintain CI/CD Azure pipeline for production code deployment for Madak Nabu and Cloudera Public Cloud
• Monitor, maintain, and debug Datahub Clusters, Virtual Warehouses, and ML Workspaces.
• Develop the data processing engine framework using scala, Iceberg and Cloudera
• Ensure compliance with applicable AbbVie software development lifecycle policies and procedures.

Tools and skills you will use in this role:

• Cloudera Data Platform – Datahub Clusters, Virtual Warehouses, ML Workspaces
• Spark with scala and pyspark
• Airflow and Modak Nabu
• Oracle, Postgres, Hive, and Iceberg

• Bachelors degree in relevant field and at least 5 years relevant experience OR Masters degree in relevant field and at least 4 years experience.
• Must have experience with metrics and logging analytics using Dynatrace and Splunk
• Must have experience with SQL, Pyspark, JavaScript,
• Must have experience with Postgres, Hive, and Iceberg
• Must have experience with Airflow and Modak Nabu
• Must have experience with Cloudera Public Cloud architecture and API-based design architecture.
• Experience working with Pharmaceutical R&D industry-centric datasets is preferred.

Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law: ​

​

• The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.​

• We offer a comprehensive package of benefits including paid time off (vacation, holidays, sick), medical/dental/vision insurance and 401(k) to eligible employees.​

• This job is eligible to participate in our short-term incentive programs. ​

​

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company’s sole and absolute discretion, consistent with applicable law. 

AbbVie is an equal opportunity employer and is committed to operating with integrity, driving innovation, transforming lives, serving our community and embracing diversity and inclusion.  It is AbbVie’s policy to employ qualified persons of the greatest ability without discrimination against any employee or applicant for employment because of race, color, religion, national origin, age, sex (including pregnancy), physical or mental disability, medical condition, genetic information, gender identity or expression, sexual orientation, marital status, status as a protected veteran, or any other legally protected group status.

US & Puerto Rico only - to learn more, visit https://www.abbvie.com/join-us/equal-employment-opportunity-employer.html 

US & Puerto Rico applicants seeking a reasonable accommodation, click here to learn more:

https://www.abbvie.com/join-us/reasonable-accommodations.html