Data Engineer - job 2 of 2

• 2+ Years of development in data engineering, such as Python, SQL, Java, or Scala.
• Experience with data processing frameworks like Apache Spark, Apache Hadoop
• Experience in relational and non-relational databases, such as MySQL, PostgreSQL, MongoDB, or Cassandra.
• Familiarity with ETL tools and frameworks like Apache Airflow, Informatica, or Talend.
• Understanding of data quality assessment techniques and familiarity with data governance practices.
• Great problem solving skills and outstanding drive for results
• Commitment to collaboration and teamwork and ability to deliver via influence
• Self-starter, who proactively identifies problems and drives for resolution
• Experience with containers and Kubernetes
• Experience in Agile Methodlogy

Responsibilities

• Processing, cleansing, and validating the integrity of data to be used for analysis
• Analyzing large amounts of information to find patterns and solutions
• Developing and maintaining data warehouses or data lakes to store and organize large volumes of structured and unstructured data.
• Ensuring compliance with data governance policies, data privacy regulations, and best practices for data management and security.
• Developing prediction systems and machine learning algorithms
• Mentor Junior Engineers
• Understand requirements and participate in developing quality code.
• Familiarity with leveraging and modifying open source libraries to build custom frameworks.

Desired Candidate profile

• Should have 3+ years as total experience.
• Experience in software development and full product life cycle.
• Excellent programming skills in any object-oriented programming languages.
• Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
• Excellent verbal and written communication and presentation skills.
• Proficiency in SQL and data modelling.

Primary Technical Skills : Java, Scala, Spark, Python

Secondary Technical Skills : Any BigData Technologies