Search is an AI-powered digital search platform, led by pioneers from powerhouses such as Google, Oracle and Netflix, Reflektion is bringing the strength of deep learning to bear on the retail and ecommerce industry. Our sophisticated platform and technology architecture, enable brands to process a tremendous amount of customer and behavioral data, respond in real time with the most relevant content or products, and understand the business impact of each new experience created. Search drives millions of incremental conversion events for retailers of all sizes, including Ann Taylor, Loft, Godiva, O'Neill Clothing and Oriental Trading.
What You’ll Do:
- Design, develop, and maintain a generic ingestion framework capable of processing various types of data (structured, semi-structured, unstructured) from customer sources.
- Implement and optimize ETL (Extract, Transform, Load) pipelines to ensure data integrity, quality, and reliability as it flows into the centralized datastore like Elasticsearch.
- Ensure the ingestion framework is scalable, secure, efficient and capable of handling large volumes of data in real-time or batch processes.
- Continuously monitor and enhance the data ingestion process to improve performance, reduce latency, and handle new data sources and formats.
- Implement large-scale near real-time streaming data processing pipelines.
- Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
What You Need to Succeed:
- Minimum 4 years of experience in a similar role, building and optimizing Big Data data pipelines, architectures and data sets
- Experience working on Big Data processing systems like Hadoop, Spark, Spark Streaming, or Flink Streaming
- Hands-on experience in two or more of these integration technologies: Java/Python, React, Golang, SQL, NoSQL (Mongo), Restful API.
- Knowledge of at least one distributed datastores like MongoDb, DynamoDB, HBase
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data systems.
Additional Skills That Could Set You Apart:
- Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
- Strong proficiency in Elasticsearch, its architecture and optimal querying of data.
How we hire:
Sitecore is proud to be an equal-opportunity workplace. We are committed to equal employment opportunity without unlawful regard to race, color, ancestry, religion, gender, national origin, sexual orientation, age, citizenship, marital status, disability, veteran status or any other local legally protected characteristic.