Databricks Data Engineer

This a Full Remote job, the offer is available from: United States, Georgia (USA)Databricks Data EngineerThe Opportunity:As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines within an organization. Your key tasks will include creating and optimizing end-to-end data flows, handling extract, transform, load (ETL) processes, designing data models, ensuring data security and compliance, collaborating with cross-functional teams, and continuously improving performance and scalability. Your expertise will bridge the gap between raw data and actionable insights, enabling efficient data processing and analytics across the business.As a big data engineer at Booz Allen, you’ll implement data engineering activities on some of the most mission-driven projects in the industry. You’ll deploy and develop pipelines and platforms that organize and make disparate data meaningful.Here, you’ll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You’ll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.Work with us to use big data for good.Join us. The world can’t wait.You Have:• 8+ years of experience in designing and developing ETL processes and managing data pipelines• 3+ years of experience with Databricks, including building and optimizing data pipelines using Databricks notebooks and clusters• Experience using Azure data services, including Azure Data Factory, Azure SQL service, Azure Blob Storage, and Azure Synapse Analytics• Experience with Azure Data Catalog for managing metadata, schema definitions, and data lineage• Experience monitoring ETL job runs, identifying bottlenecks, and troubleshooting issues, including use of Azure Monitor• Knowledge of performance optimization techniques for ETL jobs, such as partitioning, bucketing, and caching• Ability to write Python code for ETL scripts and custom transformations• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements• Bachelor’s degreeNice If You Have:• Experience with creating and maintaining Data Factory pipelines preferred• Experience with integrating machine learning models into data pipelines• Experience with stream processing frameworks, such as Apache Kafka, Azure Event Hub, and cloud-native compute services, such as Azure Functions• Experience leveraging serverless architectures for data processing• Experience ensuring data quality, privacy, and security• Knowledge of Databricks Delta Lake preferred• Knowledge of data governance practices, data lineage, and compliance requirements, such as NIST• Knowledge of tools, such as Apache Atlas, Azure Data Catalog, DVSum, or Collibra, for managing metadata, data lineage, and cataloging data assets• Ability to design and implement data models, define schemas, optimize data structures for efficient querying and analytics, and troubleshoot and improve query performanceVetting:Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.CompensationAt Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $75,600.00 to $172,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.Work ModelOur people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely.• If this position is listed as remote or hybrid, you’ll periodically work from a Booz Allen or client site facility.• If this position is listed as onsite, you’ll work with colleagues and clients in person, as needed for the specific role.EEO CommitmentWe’re an equal employment opportunity/affirmative action employer that empowers our people to fearlessly drive change – no matter their race, color, ethnicity, religion, sex (including pregnancy, childbirth, lactation, or related medical conditions), national origin, ancestry, age, marital status, sexual orientation, gender identity and expression, disability, veteran status, military or uniformed service member status, genetic information, or any other status protected by applicable federal, state, local, or international law.This offer from "Booz Allen Hamilton" has been enriched by Jobgether.com and got a 75% flex score.