Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
ML Infrastructure Engineer image - Rise Careers
Job details

ML Infrastructure Engineer

About Us:

Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health. 

Why Join Our Team:

  • Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.

  • Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.

  • Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.

  • World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.

Position Overview:


We are seeking a skilled ML Infrastructure Engineer to help design, build, and maintain a robust orchestration platform for managing a diverse set of Large Language Models (LLMs). The ideal candidate will have hands-on experience with infrastructure orchestration tools such as Kubernetes and Terraform, as well as a strong understanding of multi-cloud environments. This role offers the opportunity to work on cutting-edge technologies and play a key part in scaling our AI infrastructure.

Key Responsibilities: Infrastructure Development & Maintenance:


• Build and maintain infrastructure for deploying and managing LLMs at scale.
• Implement automated processes using Kubernetes and Infrastructure as Code (IAC) tools like Terraform.


Orchestration Platform Support:


• Contribute to the development and optimization of an orchestration platform for managing a heterogeneous set of LLMs.
• Monitor and troubleshoot issues in the platform to ensure high availability and performance.


Cloud Integration:


• Deploy and manage resources across multiple cloud platforms (e.g., AWS, Azure, Google Cloud).
• Optimize cloud resource usage for cost efficiency and scalability.


Collaboration:


• Work closely with ML engineers and DevOps teams to ensure smooth deployment and operation of AI models.
• Provide feedback on system designs and recommend improvements to infrastructure workflows.


Performance Monitoring:


• Implement tools and processes to monitor system health, identify bottlenecks, and improve model lifecycle management.
• Perform capacity planning to support growing infrastructure needs.

Qualifications:

Technical Skills:

• 3-5 years of experience in infrastructure engineering, DevOps, or a related field.

  • Experience with enterprise GPUs such as H200, H100, A100

• Proficiency with Kubernetes, Terraform, and other IAC tools.
• Familiarity with multi-cloud environments and cloud-native services (e.g., AWS Lambda, Google Cloud Run, Azure Functions).
• Programming skills in Python, Bash, or a similar language for automation and scripting.
• Basic understanding of ML workflows and frameworks like TensorFlow, PyTorch, or Hugging Face is a plus.Soft Skills: • Strong problem-solving skills and attention to detail.
• Good communication and collaboration abilities to work effectively with cross-functional teams.
• Eagerness to learn new technologies and improve existing systems.

Education & Experience: • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience).

Hippocratic AI Glassdoor Company Review
4.8 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
Hippocratic AI DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of Hippocratic AI
Hippocratic AI CEO photo
Munjal Shah
Approve of CEO

Average salary estimate

$110000 / YEARLY (est.)
min
max
$90000K
$130000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 3 days ago

Experienced Senior Sales Executive needed to lead sales efforts for innovative healthcare AI solutions targeting large health systems in the West region.

Photo of the Rise User
Posted 6 days ago

Contribute to advancing robotic surgical systems at Intuitive by leading failure analysis and supporting quality improvements in medical devices.

An entry-level Structural Acoustics Engineer role within a specialized team ensuring submarine structural designs meet noise requirements.

Posted 2 days ago

Innovative startup Eyebot seeks an Electrical Engineer to design and scale embedded systems that transform vision testing technology.

Photo of the Rise User
GSK Hybrid USA - Pennsylvania - Philadelphia
Posted 3 days ago
Dental Insurance
Disability Insurance
Vision Insurance
Flexible Spending Account (FSA)
Health Savings Account (HSA)
Performance Bonus
Family Medical Leave
Paid Holidays

Lead a skilled engineering team in advancing GSK’s data-driven medical research through cloud-native DevOps expertise and team mentorship.

Photo of the Rise User
Posted 13 days ago

Lead vehicle dynamics performance development as a Senior Vehicle Dynamics Engineer at Zoox, driving innovation in autonomous mobility.

Lead Woolpert’s Transportation Engineering team in Houston, driving complex projects, client growth, and team leadership with a focus on TxDOT partnerships.

An experienced Connectivity Engineer III role focused on managing and optimizing secure, scalable network systems for a leading defense technology provider.

Photo of the Rise User

Experienced Principal Structural Engineer needed to lead design projects and mentor teams at Valdes Architecture & Engineering in Lombard, IL.

Posted 5 days ago

Parsons invites aspiring engineers to join as an Associate Drainage Engineer to gain hands-on experience in civil engineering design and project support.

PAE Hybrid US-VA-McLean
Posted 3 days ago

Experienced Senior CAD Designer needed at Amentum to create detailed engineering drawings and 3-D CAD models while supporting classified projects in McLean, VA.

Photo of the Rise User

Seeking a Fixture Lead with expertise in precision mechanical fixture design and automation integration for the lithium-ion battery production environment.

sbdinc Hybrid Valley City, OH, United States
Posted 12 days ago

Contribute to innovative outdoor power equipment development as an Electro-Mechanical Engineer with Stanley Black & Decker’s hybrid team in Valley City, OH.

Photo of the Rise User
Mission Driven
Social Impact Driven
Passion for Exploration
Reward & Recognition

Lead the reliability testing strategy for Starlink hardware components at SpaceX, ensuring readiness for mass production.

Hippocratic AI is building a safety-focused large language model (LLM) for the healthcare industry. We believe that generative AI has the potential to massively increase healthcare access the world over but has to be built and tested responsibly. ...

109 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, on-site
DATE POSTED
January 10, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!