Manager, Data Engineering (Remote Eligible)

Thank you for your interest. Please apply for further information. Term: Full Tine Location: Metro DC Hybrid Term Vertical: Services Clearance: Please have at least a secret security clearance. Role: Data Engineer $--110-170k Data Connections Engineer for the client to play a crucial role in designing, developing, and maintaining our data infrastructure and systems. Your expertise in Python, Java, and SQL along with experience working with data integration tools and frameworks like Apache Kafka, Apache NiFi, or ETL tools will be essential in ensuring efficient data processing and analysis.Responsibilities• Collaborate with cross-functional teams are also important, as the role involves working closely with data scientists, analysts, and software developers.• Developing, maintain, and optimize data pipelines that connect various systems and databases.• Design, implement, and troubleshoot data integration solutions to meet the data needs.QualificationsRequired qualifications• Must have active SECRET clearance, TS/SCI clearance preferred• Must be in the DC Metro area and available to work onsite (Crystal City, VA, and Alexandria, VA) 2-3 days per week.• Minimum of 5 years of demonstrated experience with data integration tools like Apache Kafka, NiFi, Talend, Informatica, or similar platforms to design and manage data pipelines.• Minimum of 5 years of demonstrated experience with ETL processes, including data extraction from various sources, data cleansing, and loading into destination systems.• Strong coding skills in languages such as Python, Java, or SQL to develop and maintain data connection scripts, transformations, and data manipulation.• Solid understanding of various database systems (relational and NoSQL), data modeling, and query optimization techniques.• Familiarity with working with APIs to connect and exchange data between different systems and applications.• Proficiency in cloud platforms like AWS, Azure, or Google Cloud for setting up and managing data pipelines in a cloud environment.• Knowledge of version control systems like Git to manage and track changes to code and configurations.• Understanding of data security best practices and experience implementing encryption, authentication, and authorization mechanisms in data connections.• Ability to diagnose and resolve issues in data pipelines, including identifying bottlenecks, data quality problems, and performance optimization.• Skill in setting up monitoring and logging systems to track the health and performance of data pipelines and detect anomalies.• Effective communication and teamwork skills to collaborate with data scientists, analysts, and software engineers in cross-functional projects.• Strong problem-solving skills to identify root causes of data integration challenges and devise effective solutions.• Experience with automating data integration processes and managing them through continuous integration and continuous deployment (CI/CD) pipelines.Basic project management skills to plan, prioritize, and execute data connection projects efficiently.• Ability to learn and adapt to new technologies, tools, and techniques as the field of data engineering evolves.• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.• Detail-oriented mindset with a commitment to delivering high-quality results.• Preferred to have knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS).• Preferred to have recent DoD or IC-related experience..