Databricks Data Engineer
About us:
At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.
About the Client:
Join one of the Fortune 500 leaders in the pharmaceutical industry that is looking innovate and expand our technological capabilities. The person would join a product team working on their self-service company-wide platform that enables all the teams and business units to deploy their AI solutions, making them accessible across the entire company.
Role Overview:
We are looking for a skilled Data Engineer to support a high-impact Lakehouse migration initiative. The ideal candidate will have strong experience in building scalable data pipelines using PySpark and Databricks, with a solid understanding of lakehouse architecture and collaborative workflows using Git-based tools. You will be part of a cross-functional team responsible for modernizing data infrastructure and enabling analytical capabilities at scale.
Responsibilities:
- Design, build, and maintain scalable ETL/ELT pipelines using PySpark and Databricks Notebooks
- Work with Unity Catalog to manage data governance, lineage, and access control
- Collaborate with data scientists, architects, and analysts to ensure pipeline quality and data availability
- Develop and maintain workflow orchestration using Databricks Workflows or equivalent
- Optimize SQL queries and data transformations for performance and cost-efficiency
- Use Bitbucket or GitHub to manage source control and CI/CD practices
- Participate in code reviews, testing, and performance tuning of data processing
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, with at least 5 years of experience, specifically in Databricks.
- Experience in data engineering with Python, PySpark, and SQL
- Hands-on experience with Databricks, including Unity Catalog, workflows, and notebooks
- Strong understanding of lakehouse architecture principles
- Experience using Bitbucket or GitHub in a collaborative team environment
- Familiarity with versioning, branching, and CI/CD practices
- Excellent problem-solving skills and attention to detail
Nice to Have:
- Experience with AWS or Azure cloud platforms
- Exposure to Snowflake
- Familiarity with Jenkins or other CI/CD automation tools
KAYAK is seeking a seasoned Senior Data Engineer proficient in Python and SQL to design scalable data pipelines and collaborate across teams in a fast-paced, innovative environment.
MealMe Inc is seeking a Data Engineer to build scalable ETL pipelines and data models, enhancing our AI-ready platform for seamless merchant and customer experiences.
Experienced Senior Data Engineer needed to develop and optimize complex data architectures and pipelines in support of the National Park Service’s mission.
MealMe Inc is seeking a skilled Data Engineer to design and maintain AWS-based data pipelines that empower real-time inventory and AI-powered retail solutions.
Advance your career at Visa by designing and developing scalable, cutting-edge data platforms within the Merchant Data Platform team to deliver impactful AI and data solutions.
TWG Global is looking for a Senior AI Data Engineer to lead the development of scalable AI-driven data infrastructure supporting key business decisions in a hybrid work environment.
Experienced Data Engineers are needed at Reach Security to develop and optimize scalable data pipelines using Apache Airflow or Dagster, contributing directly to mission-critical backend infrastructure.
Contribute as a Data Engineer II to build advanced AI and data science pipelines supporting mission-critical DoD initiatives within Agile Defense.
Contribute to SchoolAI’s growth by designing and maintaining scalable BI data pipelines in a dynamic startup environment.
Vizient is looking for a knowledgeable Data Engineer to develop and optimize data warehousing solutions with a focus on Microsoft Azure technologies.
Seeking a Lead Engineer to drive advanced data engineering initiatives at ResMed, a global leader pioneering healthcare technology.
Contribute to innovative multimodal AI data pipelines and large-scale dataset engineering at Zyphra in Palo Alto.
Treasury Wine Estates is looking for a Senior Data Engineer skilled in AWS data engineering and AI solutions to drive innovative data infrastructure and analytics for their Napa location.
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
