Software Engineer, Deployment - Palo Alto

Role Summary

We are seeking experienced backend software engineers (Python, Docker, K8s) to join our Engineering team. You'll help deploy and integrate our models and APIs across multiple infrastructure configurations, from leading cloud service providers to on-premises solutions. You'll work closely with the research, product, solution architect and program management teams to serve our frontier models to customers wherever they use our technology. The role is based in Palo Alto and reports to the Head of Engineering.

Detailed role description

Key Responsibilities 

As Software Engineer in the Deployment team, you will be responsible for:

• New releases – you will ensure fast and reliable launch of new models and new features to customers

• Build and test infrastructure – you will work to improve and extend the infrastructure needed to package, deploy and integrate our core technology within first-party systems and third-party platforms

• Safety – you will help solve the unique challenges that come with maintaining AI safety on third-party platforms

• Observability and Monitoring – you will collaborate closely with both internal and external stakeholders to ensure our services achieve high availability and deliver state-of-the-art performance for our users

• Resource Optimization – you will help measure and optimize the allocation of the chips that serve our models to make the best use of costly resources.

Qualifications & Profile

• 5+ years of relevant professional work experience

• Master’s degree in Computer Science, Information Technology or a related field

• Excellent proficiency in backend software development (Python)

• Strong proficiency in infrastructure management (Docker, CI/CD, K8s, Helm, Terraform...)

• Good knowledge of cloud ecosystems and understanding of the challenges of deploying LLM in multiple environments (public cloud, private cloud, on-premises)

• Autonomous and self-starter profile

• Ability to communicate with influence

Our Culture

We're driven to build a strong company culture and are looking for individuals with solid alignment with the following:

• Reason with rigor

• Are you audacious enough?

• Make our customers succeed

• Ship early and accelerate

• Leave your ego aside 

What We Offer

• Ability to shape the exciting journey of AI and be part of the very early days of one of the hottest startup in AI

• A fun, dynamic multicultural team and collaborative work environment

• Opportunities for professional growth and development

💰 Competitive salary and bonus structure 

🚀 Generous Equity

🧑‍⚕️ Health : Competitive Healthcare program (Medical Provider: Blueshield of California 100% coverage for employee, 75% for dependents)

👴🏻 Pension : 401K (6% matching)

🏝️ PTO : 18 days 

🚗 Transportation: Reimburse office parking charges, or $120/month for public transport

🤝 Coaching: we offer Betterup coaching on a voluntary basis

🏀 Sport: $120/month reimbursement for gym membership

🥕 Meal stipend: $400 monthly allowance for meals (solution might evolve as we grow bigger)

🪪 Visa sponsorship

About Mistral 

At Mistral AI, our mission is to make AI ubiquitous and open. We are passionate about bridging the gap between technology and businesses of all sizes. We are a leading innovator in the field of open-source large language models.

Our advanced LLM solutions can be seamlessly deployed on any cloud, allowing for optimized integration and robust performance. Developers are using our API via la Plateforme to build incredible AI-first applications powered by our models that can understand and generate natural language text and code. We are multilingual at our core. We released le Chat, as a demonstrator of our models.

We are a tight-knit, nimble team dedicated to bringing our cutting-edge AI technology to the world. Our teams are distributed between France, UK and USA. We are creative, low-ego, team-spirited, and have been passionate about AI for years. We hire people who thrive in competitive environments, because they find them more fun to work in. We hire passionate women and men from all over the world.