Staff, Software Engineer (Machine Learning Engineer) | Personalization | Real Time Inference Systems - job 2 of 6

Position Summary...What you'll do...Are you a seasoned Machine Learning Engineer with 5+ years of experience working on ranking, online advertising, recommender systems, ecommerce? If YES, then you are in LUCK!!Walmart is looking to hire a highly seasoned Machine Learning Engineer for the Personalization team who would love to make an impact & change the future of retail. If you're a seasoned professional with experience in developing a Real Time Inference System, deploying large scale deep learning ML models, and implementing MLOps best practices, and if you have led design discussions for a scalable ML platform and mentored teams in an agile environment, we'd love to hear from you.• *Immigration sponsorship is not available in this role.**About the Team : Personalization team at Walmart is dedicated to the mission of knowing our customers better and making it frictionless and faster for them to get what they want while building a trusted partnership with Walmart. We help bring a seamless experience to our customers irrespective of how and where they engage with us - while shopping online or picking groceries at stores. We thrive to provide each customer with a journey tailored to their individual needs, preferences and routines. We operate at the intersection of huge Walmart assortment, millions of customers, thousands of stores and Walmart associates - a multi-layer multi-objective problem space which has a unique impact on Global customer base and powers assisted AI for our associates.The Personalization team consists of big data geeks, application engineers, scientists and product visionaries all working together to design, prototype and build technology-driven products and experiences that will change the future landscape of e-commerce. We are focused on building an intelligent system that will enable 1:1 personalized customer experience, from finding the product to delivering it to the customer. We are building state-ofthe-art probabilistic models and engineering marvels to serve our customer needs by leveraging cutting edge machine learning, deep learning, reinforcement learning, natural language processing, entity-relationship extraction and knowledge representation. This will span many markets, business models and form factors; therefore, we are looking for scientists and engineers who will bring not only an abundance of experiences in technologies, but an abundant curiosity to innovate.What you'll do :• Design and development of Real Time Inference System which will be used for deploying deep learning models or traditional ML models and run inferences on-demand at low latency. This system should be capable of scaling horizontally and will be deployed onto kubernetes based cluster. This platform will be capable of supporting different ml frameworks like TensorRT, TensorFlow, PyTorch, ONNX and Custom. This Real Time Inference system plays an important role in providing recommendations based on current user context.• Develop capabilities to support inferencing of Gen AI models, and support other LLM techniques like RAG, model fine tuning, building semantic cache.• Develop and implement best practices in MLOps to streamline the development, deployment, and monitoring of ML models. This includes complete model lifecycle management, ensuring model reproducibility, and facilitating seamless model versioning, rollout, monitoring and updating.• Collaborate with product managers, data scientists, and other engineering teams to understand their needs and translate them into ML platform capabilities. This collaborative approach ensures that the ML infrastructure effectively supports product features and business objectives.• Lead architectural and design discussions to ensure our platform is modular, scalable, fault tolerant, and sustainably built• Mentor and grow team members while working in an agile environment and ensure best engineering practices are followed.What you'll bring :• Bachelors degree in Computer Science, Information Technology, Engineering or related field and 7+ years' experience OR Masters degree in Computer Science, Information Technology, Engineering or related field and 5 + years' experience in an related field.• You're experienced with building real time inference systems for deploying deep learning or traditional ML models.• Experience with developing Restful APIs using Python and Flask.• Experience working with Triton Inference Server.• Experience with deploying and building real time systems for LLMs• You have experience working on ranking, online advertising, recommender systems, ecommerce , or relevant areas• Working knowledge of setting up RAG• Experience working with model lifecycle management tools like ML Flow and KF Serving• Strong Expertise in Java, Object Oriented & Functional Programming, Design Patterns.• In-depth knowledge of No-SQL and RDBMS technologies.• Proficient with event driven architecture using Kafka.• Advanced knowledge of complex software design, distributed system design, design patterns, data structures and algorithms.• Working knowledge in container and cloud native technologies - Kubernetes, Docker.• Proficient in building scalable Microservices using Spring framework.• Experience with CI/CD tools such as Jenkins and Maven.• Strong expertise with Cloud Technologies like Azure and GCP.• Experience in monitoring production systems and using different systems like Grafana, Prometheus.• You have strong written and oral communication skills.• Experience with all phases of the software development life cycle, best practices, and Agile Software Development.About Walmart Global Tech :Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.Flexible, Hybrid work :We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives.Benefits :Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.Equal Opportunity Employer :Walmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions - while being inclusive of all people.The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.‎‎‎You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.‎For information about PTO, see https://one.walmart.com/notices .‎‎Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.‎Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.‎For information about benefits and eligibility, see One.Walmart .‎Hoboken, New Jersey US-10279/Bellevue, Washington US-11075:The annual salary range for this position is $132,000.00-$264,000.00‎Sunnyvale, California US-04397:The annual salary range for this position is $143,000.00-$286,000.00‎‎‎‎‎‎‎‎‎‎Additional compensation includes annual or quarterly performance bonuses.‎Additional compensation for certain positions may also include:‎‎- Stock‎‎Minimum Qualifications...Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering or related area.Option 2: 6 years' experience in software engineering or related area.Preferred Qualifications...Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.Master's degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart's accessibility standards and guidelines for supporting an inclusive culture.Primary Location...680 West California Avenue, Sunnyvale, CA 94086-4834, United States of America