Staff Machine Learning Engineers at Hippocratic AI are foundational to the design, deployment, and optimization of cutting-edge ML systems powering our next-generation, safety-focused generative AI for healthcare. You’ll work closely with research scientists and product teams to build scalable infrastructure and models that support robust, real-time, and personalized conversational AI capabilities.
We are seeking an experienced Staff Machine Learning Engineer to lead the development of machine learning pipelines, contribute to training and inference systems for Large Language Models (LLMs), and drive the productionization of ML models that directly impact healthcare delivery and patient outcomes. This role is both strategic and hands-on, perfect for someone excited about technical leadership in a fast-paced, mission-driven environment.
Our engineering challenges include:
Designing scalable, high-performance infrastructure for LLM training, fine-tuning, and inference
Building ML pipelines and tooling for experimentation, evaluation, and deployment
Optimizing model performance and efficiency in production environments
Collaborating cross-functionally to integrate ML solutions into end-user applications
Maintaining compliance with healthcare standards of safety, privacy, and reliability
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field; PhD is a plus
7+ years of industry experience building and deploying ML systems, ideally with focus on LLMs or deep learning
Strong software engineering skills and experience developing in Python
Deep experience with ML frameworks like PyTorch or TensorFlow
Familiarity with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod)
Proven experience designing, implementing, and scaling ML pipelines for large models
Experience with cloud platforms (e.g., AWS, GCP, Azure) and container orchestration (e.g., Kubernetes, Docker)
Exposure to healthcare, clinical, or life sciences data is a strong plus
Strong preference for individuals who can work onsite at our HQ located in Palo Alto, CA, but we will consider candidates throughout the U.S.
As a Staff ML Engineer at Hippocratic AI, you’ll have a seat at the table in technical decision-making, partner closely with product and research leads, and help define the roadmap for scalable, safe ML systems. This role offers the chance to be deeply embedded in a team of engineers and scientists pioneering the future of healthcare-focused AI.
Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.
World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
For more information, visit www.HippocraticAI.com.
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA unless explicitly noted otherwise in the job description.
Polaris: A Safety-focused LLM Constellation Architecture for Healthcare, https://arxiv.org/abs/2403.13313
Polaris 2: https://www.hippocraticai.com/polaris2
Personalized Interactions: https://www.hippocraticai.com/personalized-interactions
Human Touch in AI: https://www.hippocraticai.com/the-human-touch-in-ai
Empathetic Intelligence: https://www.hippocraticai.com/empathetic-intelligence
Research and clinical blogs: https://www.hippocraticai.com/research
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
As a Staff Machine Learning Engineer at Hippocratic AI in Palo Alto, you will play a pivotal role in the design and deployment of innovative machine learning systems that are set to revolutionize healthcare. Your expertise will be key in building the infrastructure and models that enable sophisticated, real-time conversational AI capabilities aimed at improving patient outcomes. You'll collaborate closely with research scientists and product teams, integrating your technical leadership in a fast-paced, mission-driven environment. The work will involve creating high-performance infrastructure for large language model (LLM) training and inference, refining ML pipelines for evaluation and deployment, and ensuring that our model operations comply with rigorous healthcare standards. Your background in industry, with over 7 years of experience in ML system development, particularly in LLMs or deep learning, will be essential. Alongside your strong programming capabilities in Python and familiarity with ML frameworks like PyTorch or TensorFlow, your skills in cloud platforms and container orchestration systems will help shape the future of healthcare-focused AI. If you're excited about making a tangible impact in the healthcare sector and working alongside a world-class team, Hippocratic AI is the place for you.
Join Hippocratic AI to lead customer success initiatives and transform healthcare outcomes with innovative AI solutions.
Hippocratic AI is looking for experienced Senior Applied Scientists in Human Behavioral Science to lead advancements in empathetic AI technologies tailored for healthcare.
Join F1RST Digital Services as an IT Engineer Spec IV (Full Stack) to be part of an innovative team driving technological advancement.
Join Canon U.S.A. as a Field Service Engineer II and contribute to cutting-edge semiconductor technology while providing top-notch customer support.
Averna is looking for a Senior PLC Engineer to lead automation systems development in a high-tech, global environment.
As a Propulsion Test Intern at Hermeus, immerse yourself in the world of high-performance propulsion systems and contribute to hypersonic aircraft development.
Join d-Matrix as a Manufacturing Test Engineer and be part of a team that drives innovation in AI technology.
Join AFRY as a passionate product developer and contribute to designing innovative and sustainable solutions in a dynamic team environment.
Become an integral part of Intel's semiconductor technology team as a Sample Prep Engineer, focusing on cutting-edge debugging techniques and innovation.
Join Northrop Grumman as a Principal or Senior Principal NDI Engineer and play a key role in advancing innovative inspection solutions.
Hippocratic AI is building a safety-focused large language model (LLM) for the healthcare industry. We believe that generative AI has the potential to massively increase healthcare access the world over but has to be built and tested responsibly. ...
108 jobsSubscribe to Rise newsletter