Senior Big Data Engineer - Scala

DescriptionWe are hiring a Senior Big Data Engineer who will support a critical digital transformation project for one of EPAM’s top clients. This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!Req.#533825107ResponsibilitiesEvaluate different technologies and suggest which technology suits the client's needsComplete POC and evolve it into production-ready solutionsSelect and integrate any Big Data tools and frameworks required to provide requested capabilitiesImplement ETL processMonitor performance and advise any necessary infrastructure changesDefine data retention policiesElaborate on the technical design of new featuresRequirementsAt least 2 years of experience with ScalaAt least 2 years of experience with Java or PythonProficient understanding of distributed computing principlesProficiency with HDFSGood knowledge of Big Data querying tools, such as Hive and ImpalaProven history of building stream-processing systems, using solutions such as Spark-StreamingExperience with Spark RDD/DataFrame API using Java/ScalaExperience with integration of data from multiple data sourcesKnowledge of various ETL techniques and frameworksComfortable with various messaging systems, such as KafkaExperience with Cloudera platformNice to haveExperience with Apache KafkaExperience with Apache OozieBenefitsMedical, Dental and Vision Insurance (Subsidized)Health Savings AccountFlexible Spending Accounts (Healthcare, Dependent Care, Commuter)Short-Term and Long-Term Disability (Company Provided)Life and AD&D Insurance (Company Provided)Employee Assistance ProgramUnlimited access to LinkedIn learning solutionsMatched 401(k) Retirement Savings PlanPaid Time OffLegal Plan and Identity Theft ProtectionAccident InsuranceEmployee DiscountsPet InsuranceEmployee Stock Purchase ProgramAbout EPAMEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potentialAdditionalThis posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $90k – $150k. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the positionEPAM welcomes all applicants and will consider qualified candidates with criminal history such as arrest and conviction records in a manner consistent applicable law, including the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for HiringApply#J-18808-LjbffrOriginal job Senior Big Data Engineer - Scala posted on GrabJobs ©. To flag any issues with this job please use the Report Job button on GrabJobs.