Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Staff Machine Learning Engineer, Applied Science  image - Rise Careers
Job details

Staff Machine Learning Engineer, Applied Science

Overview

Staff Machine Learning Engineers at Hippocratic AI are foundational to the design, deployment, and optimization of cutting-edge ML systems powering our next-generation, safety-focused generative AI for healthcare. You’ll work closely with research scientists and product teams to build scalable infrastructure and models that support robust, real-time, and personalized conversational AI capabilities.

We are seeking an experienced Staff Machine Learning Engineer to lead the development of machine learning pipelines, contribute to training and inference systems for Large Language Models (LLMs), and drive the productionization of ML models that directly impact healthcare delivery and patient outcomes. This role is both strategic and hands-on, perfect for someone excited about technical leadership in a fast-paced, mission-driven environment.

Our engineering challenges include:

  • Designing scalable, high-performance infrastructure for LLM training, fine-tuning, and inference

  • Building ML pipelines and tooling for experimentation, evaluation, and deployment

  • Optimizing model performance and efficiency in production environments

  • Collaborating cross-functionally to integrate ML solutions into end-user applications

  • Maintaining compliance with healthcare standards of safety, privacy, and reliability

Required Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field; PhD is a plus

  • 7+ years of industry experience building and deploying ML systems, ideally with focus on LLMs or deep learning

  • Strong software engineering skills and experience developing in Python

  • Deep experience with ML frameworks like PyTorch or TensorFlow

  • Familiarity with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod)

  • Proven experience designing, implementing, and scaling ML pipelines for large models

  • Experience with cloud platforms (e.g., AWS, GCP, Azure) and container orchestration (e.g., Kubernetes, Docker)

  • Exposure to healthcare, clinical, or life sciences data is a strong plus

Other Requirements

  • Strong preference for individuals who can work onsite at our HQ located in Palo Alto, CA, but we will consider candidates throughout the U.S.

As a Staff ML Engineer at Hippocratic AI, you’ll have a seat at the table in technical decision-making, partner closely with product and research leads, and help define the roadmap for scalable, safe ML systems. This role offers the chance to be deeply embedded in a team of engineers and scientists pioneering the future of healthcare-focused AI.

Why Join Our Team

Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.
World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.

For more information, visit www.HippocraticAI.com.

We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA unless explicitly noted otherwise in the job description.

References

  1. Polaris: A Safety-focused LLM Constellation Architecture for Healthcare, https://arxiv.org/abs/2403.13313

  2. Polaris 2: https://www.hippocraticai.com/polaris2

  3. Personalized Interactions: https://www.hippocraticai.com/personalized-interactions

  4. Human Touch in AI: https://www.hippocraticai.com/the-human-touch-in-ai

  5. Empathetic Intelligence: https://www.hippocraticai.com/empathetic-intelligence

  6. Polaris 1: https://www.hippocraticai.com/research/polaris

  7. Research and clinical blogs: https://www.hippocraticai.com/research

Hippocratic AI Glassdoor Company Review
4.8 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
Hippocratic AI DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of Hippocratic AI
Hippocratic AI CEO photo
Munjal Shah
Approve of CEO

Average salary estimate

$175000 / YEARLY (est.)
min
max
$150000K
$200000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Staff Machine Learning Engineer, Applied Science , Hippocratic AI

As a Staff Machine Learning Engineer at Hippocratic AI in Palo Alto, you will play a pivotal role in the design and deployment of innovative machine learning systems that are set to revolutionize healthcare. Your expertise will be key in building the infrastructure and models that enable sophisticated, real-time conversational AI capabilities aimed at improving patient outcomes. You'll collaborate closely with research scientists and product teams, integrating your technical leadership in a fast-paced, mission-driven environment. The work will involve creating high-performance infrastructure for large language model (LLM) training and inference, refining ML pipelines for evaluation and deployment, and ensuring that our model operations comply with rigorous healthcare standards. Your background in industry, with over 7 years of experience in ML system development, particularly in LLMs or deep learning, will be essential. Alongside your strong programming capabilities in Python and familiarity with ML frameworks like PyTorch or TensorFlow, your skills in cloud platforms and container orchestration systems will help shape the future of healthcare-focused AI. If you're excited about making a tangible impact in the healthcare sector and working alongside a world-class team, Hippocratic AI is the place for you.

Frequently Asked Questions (FAQs) for Staff Machine Learning Engineer, Applied Science Role at Hippocratic AI
What are the key responsibilities of a Staff Machine Learning Engineer at Hippocratic AI?

The Staff Machine Learning Engineer at Hippocratic AI is responsible for designing scalable infrastructure for ML systems, creating machine learning pipelines, optimizing the performance of models, and ensuring compliance with healthcare regulations. This role combines both strategy and hands-on technical tasks, making a significant impact on healthcare delivery.

Join Rise to see the full answer
What qualifications are needed for the Staff Machine Learning Engineer role at Hippocratic AI?

Candidates for the Staff Machine Learning Engineer position at Hippocratic AI should have a Bachelor’s or Master’s degree in Computer Science or a related field, with a PhD being a plus. Additionally, over 7 years of experience in developing ML systems, strong Python development skills, and proficiency in using ML frameworks like PyTorch or TensorFlow are required.

Join Rise to see the full answer
How does working at Hippocratic AI impact healthcare?

Staff Machine Learning Engineers at Hippocratic AI contribute to developing safety-focused AI models that aim to improve health outcomes globally. By building robust ML systems and collaborating with healthcare professionals, engineers help provide personalized and efficient healthcare solutions.

Join Rise to see the full answer
What technologies are essential for the Staff Machine Learning Engineer position at Hippocratic AI?

Essential technologies for this role include Python for software development, ML frameworks like PyTorch or TensorFlow, and cloud platforms such as AWS or GCP. Experience with distributed training frameworks and container orchestration tools like Kubernetes is also valuable.

Join Rise to see the full answer
What team dynamics can be expected at Hippocratic AI?

At Hippocratic AI, you can expect a collaborative environment where the Staff Machine Learning Engineer works closely with researchers, product teams, and other engineers. The team values in-person interactions to foster creativity and innovation, with a shared mission of advancing healthcare through AI.

Join Rise to see the full answer
Common Interview Questions for Staff Machine Learning Engineer, Applied Science
Can you describe your experience with machine learning frameworks like TensorFlow or PyTorch?

In your response, emphasize specific projects where you utilized either TensorFlow or PyTorch. Talk about the complexity of the models you built and the performance improvements you achieved. Showcase your problem-solving approach and how you stayed updated on recent advancements in these frameworks.

Join Rise to see the full answer
How do you approach optimizing machine learning models for performance and efficiency?

Discuss specific methods you've leveraged for model optimization, such as hyperparameter tuning, pruning, or quantization. Provide examples from your past work where you've made models more efficient without compromising accuracy, and mention any metrics you used to measure improvement.

Join Rise to see the full answer
What is your experience with cloud platforms and container orchestration tools?

Detail your experience with cloud services like AWS or GCP, and how you've utilized container orchestration tools like Kubernetes or Docker for deployment. Discuss incidents where these technologies helped you scale model deployment or improve operational efficiency.

Join Rise to see the full answer
Describe a successful machine learning project you've led.

Outline the project's goals, technologies used, challenges faced, and how you overcame them. Highlight your leadership role and the positive impact the project had on the organization or user outcomes, emphasizing teamwork and collaborative efforts.

Join Rise to see the full answer
How familiar are you with compliance standards in the healthcare sector?

Discuss any previous experiences related to compliance, particularly in healthcare. Talk about the importance of patient data privacy and safety, and provide examples of how you ensured your projects adhered to regulations.

Join Rise to see the full answer
What strategies do you use for debugging machine learning models?

Share your systematic approach to debugging models, including data validation methods, examining model outputs, and analyzing training data. Discuss examples of problems you encountered and how you resolved them, highlighting your critical thinking skills.

Join Rise to see the full answer
How do you stay current with advancements in machine learning and AI?

Emphasize your commitment to continuous learning by mentioning conferences, online courses, or reading current research papers. Share how these learning opportunities have influenced your work or sparked ideas for new projects.

Join Rise to see the full answer
Can you explain your experience designing machine learning pipelines?

Provide specific details about how you've designed and implemented ML pipelines. Discuss the tools and frameworks used, the challenges faced, and how you ensured the pipeline could handle scalability and maintainability.

Join Rise to see the full answer
What is your understanding of large language models (LLMs) and their applications?

Articulate your understanding of LLMs, including their mechanisms and how they can be applied in real-world scenarios. Share any relevant experience you've had with LLMs and discuss their potential impact on fields such as healthcare.

Join Rise to see the full answer
How do you collaborate with cross-functional teams in a project?

Discuss your communication strategies for working with product managers and data scientists. Provide examples of successful collaborations, how you ensure that everyone's input is valued, and the positive impact it has on project outcomes.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User

Join Hippocratic AI to lead customer success initiatives and transform healthcare outcomes with innovative AI solutions.

Photo of the Rise User

Hippocratic AI is looking for experienced Senior Applied Scientists in Human Behavioral Science to lead advancements in empathetic AI technologies tailored for healthcare.

Photo of the Rise User

Join F1RST Digital Services as an IT Engineer Spec IV (Full Stack) to be part of an innovative team driving technological advancement.

Join Canon U.S.A. as a Field Service Engineer II and contribute to cutting-edge semiconductor technology while providing top-notch customer support.

Averna Hybrid No. 5 Xinghan Street, Industrial Park, Suzhou, Jiangsu, China
Posted 9 hours ago

Averna is looking for a Senior PLC Engineer to lead automation systems development in a high-tech, global environment.

Photo of the Rise User
Posted 7 days ago

As a Propulsion Test Intern at Hermeus, immerse yourself in the world of high-performance propulsion systems and contribute to hypersonic aircraft development.

Posted 9 days ago

Join d-Matrix as a Manufacturing Test Engineer and be part of a team that drives innovation in AI technology.

Photo of the Rise User
AFRY Remote Stockholm, Sverige
Posted 11 days ago

Join AFRY as a passionate product developer and contribute to designing innovative and sustainable solutions in a dynamic team environment.

Photo of the Rise User
Intel Hybrid US, Oregon, Hillsboro
Posted 7 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Customer-Centric
Snacks
Onsite Gym
Family Coverage (Insurance)
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Learning & Development
Paid Time-Off
401K Matching
Maternity Leave
Paternity Leave

Become an integral part of Intel's semiconductor technology team as a Sample Prep Engineer, focusing on cutting-edge debugging techniques and innovation.

Posted 10 days ago

Join Northrop Grumman as a Principal or Senior Principal NDI Engineer and play a key role in advancing innovative inspection solutions.

Hippocratic AI is building a safety-focused large language model (LLM) for the healthcare industry. We believe that generative AI has the potential to massively increase healthcare access the world over but has to be built and tested responsibly. ...

108 jobs
MATCH
VIEW MATCH
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, on-site
DATE POSTED
April 10, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
13 people applied to UI Developer Intern at RainFocus
Photo of the Rise User
Someone from OH, Akron just viewed Accounting Co-Op at VEGA Americas
R
Someone from OH, Cincinnati just viewed Director, Payroll Tax at Ryan
P
Someone from OH, Columbus just viewed Data Science for Smart Agriculture- Part-Time at PSU
Photo of the Rise User
Someone from OH, Cincinnati just viewed Brand Management & Partnerships Assistant at LAIKA
Photo of the Rise User
Someone from OH, Athens just viewed Senior Multimedia Artist, Design & Creative at RepRisk AG
Photo of the Rise User
29 people applied to Supervisor, Plumbing at SpaceX
H
Someone from OH, Rocky River just viewed Training Manager at Hotel Bardo Savannah
F
Someone from OH, Columbus just viewed VP of Communications at Freedom Together Foundation
Photo of the Rise User
Someone from OH, Columbus just viewed Chief Organizational Communication Officer at Providence
Photo of the Rise User
10 people applied to Pega Engineer at Proxymity
Photo of the Rise User
Someone from OH, Cuyahoga Falls just viewed SEASONER at Shearer's Foods
Photo of the Rise User
Someone from OH, Columbus just viewed Bilingual Care Manager, Telephonic RN at Humana
Photo of the Rise User
Someone from OH, Columbus just viewed Talent Business Partner at Red Bull
Photo of the Rise User
Someone from OH, Brunswick just viewed Sanitation Team Member at Shearer's Foods
Photo of the Rise User
Someone from OH, Columbus just viewed Talent Acquisition Specialist at Beghou Consulting
C
Someone from OH, Middletown just viewed Operations Analyst at Core Specialty Insurance
A
Someone from OH, Strongsville just viewed Graphic Design Intern at Anvil NorthWest
W
Someone from OH, Uhrichsville just viewed Director Operations at WVUMedicine