Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Data Engineer image - Rise Careers
Job details

Data Engineer

Emids is a leading provider of digital transformation solutions to the healthcare industry, serving payers, providers, life sciences, and technology firms. Headquartered in Nashville, emids helps bridge critical gaps in providing accessible, affordable, and high-quality healthcare by providing digital transformation services, custom application development, data engineering, business intelligence solutions, and specialized consulting services to all parts of the healthcare ecosystem. With nearly 2,500 professionals globally, emids leverages strong domain expertise in healthcare-specific platforms, regulations, and standards to provide tailored, cutting-edge solutions and services to its clients.

Job Title: Azure Data Engineer

Location: Louisville, KY (Remote)

Job Details:                   

Considering Python as the ETL tool for reading data from the source, handling datatype and data transformations, managing error handling, logging, and loading data into Databricks-managed Delta tables, the candidate should have strong expertise in Python, along with solid knowledge of Databricks and PySpark, enabling them to evaluate and perform data transformations within Databricks. They should be proficient in all aspects of Python, including classes, objects, methods, dictionaries, loops, Wheel files, and packages, and should be able to connect to various data sources, including databases and streaming data,

Expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake is also required.

  • The ideal candidate has extensive experience in data engineering, working with large-scale data infrastructures, and optimizing ETL processes
  • Expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake
  • At least 6+ years of experience in data engineering, with a focus on building data pipelines
  • Proven experience with Spark, Scala, and other related technologies
  • Familiarity with Could Warehouses, data lakes, storage formats.
  • Strong knowledge of data modeling and ETL processes
  • Experience leading data engineering projects.
  • Proven experience with Databricks and Apache Spark
  • Strong proficiency in Python
  • Experience in Unix shell scripting and scheduling tools

 

Here at Emids we're not scared of differences. It's how we break new ground. As we scale and elevate the experience of our clients in the Healthcare & LifeSciences Space and ultimately have an impact on every patient from every walk of life, the team we build must be reflective of the diversity that we serve. Together, we've built and will continue to grow, a diverse and inclusive culture where everyone has a seat at the table and the space to be their most authentic self. Emids believes in being an Equal Opportunity Employer and we support, celebrate, and cherish all the things that make our teammates who they are.

emids Glassdoor Company Review
3.6 Glassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon Glassdoor star icon
emids DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of emids
emids CEO photo
Saurabh Sinha
Approve of CEO
What You Should Know About Data Engineer, emids

At Emids, we are seeking a talented and experienced Data Engineer to join our innovative team in Louisville, KY (Remote). As a leading provider of digital transformation solutions for the healthcare industry, we value the role of the Data Engineer in enhancing our ability to deliver accessible and high-quality healthcare services. In this role, you’ll harness the power of Python for ETL processes, read and transform data from various sources, and ensure smooth data integration within Databricks-managed Delta tables. Your expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake will allow you to navigate complex data infrastructures expertly. You will collaborate with our skilled professionals to optimize ETL processes and manage large-scale data environments. This position requires a minimum of 6 years of data engineering experience, proving your proficiency in Python, Spark, and related technologies while also showcasing your ability to lead data projects. At Emids, we believe in a diverse, inclusive work culture that reflects the patients we serve, ensuring everyone has a chance to be their authentic selves. With us, you will impact not just the healthcare industry but also the lives of individuals across the nation. Join us at Emids, where your skills can make a real difference!

Frequently Asked Questions (FAQs) for Data Engineer Role at emids
What are the main responsibilities of a Data Engineer at Emids?

As a Data Engineer at Emids, your primary responsibilities will include developing and managing data pipelines using Python and Databricks, ensuring efficient ETL processes, and collaborating with teams to integrate data from various databases and streaming sources. You will also optimize large-scale data infrastructures and lead data engineering projects that enhance our healthcare solutions.

Join Rise to see the full answer
What qualifications are required for the Data Engineer position at Emids?

To succeed as a Data Engineer at Emids, candidates should have at least 6 years of experience in data engineering, a strong command of Python, and expertise in Databricks and Azure services, including Azure SQL Database and Azure Data Factory. Familiarity with data modeling, ETL processes, and Unix shell scripting is also essential.

Join Rise to see the full answer
What technologies do Data Engineers at Emids work with?

Data Engineers at Emids utilize a variety of cutting-edge technologies including Python, Apache Spark, and Databricks for data transformations. You will also engage with Azure services like Azure Data Lake and Azure Synapse Analytics, enabling seamless integration and management of vast amounts of healthcare data.

Join Rise to see the full answer
Does Emids promote diversity and inclusion among its Data Engineers?

Absolutely! At Emids, we emphasize building a diverse and inclusive culture. As a Data Engineer, you’ll be part of an environment that values unique perspectives and encourages everyone to bring their authentic selves to work, reflecting the diversity of the communities we serve in healthcare.

Join Rise to see the full answer
What growth opportunities are available for Data Engineers at Emids?

Emids fosters a collaborative and growth-oriented environment. As a Data Engineer, you will have numerous opportunities for professional development through training sessions, participation in innovative projects, and the chance to work alongside industry experts, allowing you to advance your career in the data engineering field.

Join Rise to see the full answer
Common Interview Questions for Data Engineer
How do you handle data quality issues during the ETL process?

In handling data quality issues, focus on implementing validation checks during the ETL process to catch discrepancies early. Describe your approach to identifying data anomalies, applying transformations to clean the data, and conducting regular data audits to maintain high-quality datasets.

Join Rise to see the full answer
Can you explain how you would use Azure Data Factory for data integration?

When using Azure Data Factory for data integration, first outline how you create pipelines that connect to various data sources. Discuss the process of pulling data from these sources, transforming it as needed, and loading it into target systems, highlighting your understanding of the service's features like triggers, data flows, and monitoring.

Join Rise to see the full answer
What strategies have you employed to optimize ETL processes?

Share specific strategies like reducing data load times through parallel processing, leveraging data partitioning, and optimizing SQL queries. Discuss your experience in monitoring ETL performance and how you have adjusted your approach based on analytics results to enhance efficiency.

Join Rise to see the full answer
Describe a complex data engineering project you led. What challenges did you face?

For a comprehensive answer, describe a relevant project in detail, focusing on your leadership role, the complexity of the data requirements, and team collaboration. Highlight challenges like data source inconsistencies or performance bottlenecks and how you successfully navigated these obstacles.

Join Rise to see the full answer
How comfortable are you with using PySpark for large-scale data processing?

Detail your experience with PySpark, focusing on specific use cases where you employed it for data transformations, aggregations, or machine learning tasks. Discuss its advantages for large datasets, emphasizing how it fits into your data processing pipeline.

Join Rise to see the full answer
What techniques do you use for data modeling?

Explain your approach to data modeling, emphasizing techniques such as entity-relationship modeling, normalization, and dimensional modeling. Discuss how these techniques help in structuring data for efficient querying and reporting, particularly in healthcare contexts.

Join Rise to see the full answer
How do you approach learning new tools and technologies?

Convey your proactive learning approach by discussing how you keep abreast of industry trends, utilize online resources, attend workshops, and engage with communities. Provide examples of technologies you successfully adopted and integrated into your workflow.

Join Rise to see the full answer
Can you explain your experience with data lakes?

Discuss your understanding of data lakes, their importance in handling unstructured data, and your experience implementing them. Share practical examples where you managed data ingestion and processing within a data lake environment and how it supported analytics.

Join Rise to see the full answer
What role do you think scripting languages play in data engineering?

Describe the significance of scripting languages, especially Python, in automating data workflows, performing data manipulations, and creating reusable scripts for ETL tasks. Dive into specific instances where you've effectively used scripting to streamline processes.

Join Rise to see the full answer
How do you ensure effective communication with non-technical stakeholders?

Emphasize the importance of simplifying complex technical concepts for non-technical stakeholders. Discuss your strategies for active listening, using visual aids, and providing data-driven narratives that make your insights accessible and relatable.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Posted 13 days ago
Photo of the Rise User
Platzi Remote No location specified
Posted 4 days ago
Photo of the Rise User
Posted 9 days ago
Photo of the Rise User
Palta Remote Simple Cyprus or remote
Posted 12 days ago

To be the Partner and Employer of Choice in core healthcare technology and operations. We will be the Partner of Choice by providing superior value to our customers through thought leadership, specialization and technology expertise. We will be ...

8 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
January 15, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
38 people applied to Entry Data Entry Jobs at UPS
Photo of the Rise User
Someone from OH, Toledo just viewed Facility Grounds Attendant at Owens Corning
Photo of the Rise User
Someone from OH, Mason just viewed Finance Manager/Controller at Remote VA
Photo of the Rise User
Someone from OH, Galloway just viewed HR Intern at Worthington Industries
Photo of the Rise User
12 people applied to Junior Data Analyst at Experian
Photo of the Rise User
Someone from OH, Cincinnati just viewed Intern-Product Designer-Pittsburgh, PA 2025 at Philips
Photo of the Rise User
Someone from OH, Reynoldsburg just viewed Security Analyst Jr at DEUNA
Photo of the Rise User
Someone from OH, Reynoldsburg just viewed Jr. QA Tester at Amber Studio
C
Someone from OH, Reynoldsburg just viewed Jr SaaS Integration Engineer at City IT
Photo of the Rise User
Someone from OH, Cincinnati just viewed Strategic Finance Internship at Procter & Gamble
Photo of the Rise User
Someone from OH, Cleveland just viewed Developer Advocate at Timescale
Photo of the Rise User
Someone from OH, Cleveland just viewed Sr. Developer Advocate at ServiceNow
Photo of the Rise User
Someone from OH, Cleveland just viewed Lead Developer Advocate - Observability at SmartBear
Photo of the Rise User
Someone from OH, Loveland just viewed Shipping Clerk 19-20/hr Start Immediately at Aerotek
R
Someone from OH, Akron just viewed Live Chat Agent at RE/MAX 4000 Inc
Photo of the Rise User
Someone from OH, Cincinnati just viewed MDS Registered Nurse at Otterbein SeniorLife
Photo of the Rise User
Someone from OH, Cincinnati just viewed Tax Specialist - Editing at Paycor
Photo of the Rise User
Someone from OH, Cleveland just viewed Security Guard at Lincoln Electric
Photo of the Rise User
Someone from OH, Bowling Green just viewed Entry Level Customer Service/Sales at Global Elite
Photo of the Rise User
Someone from OH, Columbus just viewed 2025 Finance Intern at Abbott
Photo of the Rise User
Someone from OH, Upper Sandusky just viewed Help Desk Support Specialist | Network Solutions (Remote) at CBIZ
Photo of the Rise User
Someone from OH, Massillon just viewed Production Technician at bp
Photo of the Rise User
Someone from OH, Cleveland just viewed Bacolod - Player Engagement - Team Lead at Keywords Studios
Photo of the Rise User
Someone from OH, Cincinnati just viewed Marketing Intern at ADM
N
Someone from OH, Springfield just viewed Robotics System Engineer at NODA AI
V
Someone from OH, Cleveland just viewed Customer Service Executive at Virtual Staff 365
Photo of the Rise User
Someone from OH, Cleveland just viewed 100% Work from Home Benefits Rep at Global Elite
Photo of the Rise User
Someone from OH, New London just viewed Amazon customer service at Amazon