Data Engineer: Big Data; ETL - Big Data

Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python • 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data • Hands-on experience with GCP, google composer, bigQuery and bigTable... • Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data. • Hands-on experience with programming using Python/Scala • Understanding of Cloud Native Principles and architectures and Experience in creating platform level cloud native system architecture with low latency, high throughput, and high availability. • Have experience in designing and building Cloud native applications. Experience in cloud platforms like Docker, Kubernetes, OpenShift are a plus. • Expert on Hadoop and Spark Architecture and its working principle • Experience in UNIX shell scripting • Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have. • Teamwork & ability to multi-task • Excellent communication skills Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company