Job details

Software Engineer (ML infra)

About Us:

PlayHT is at the forefront of generative voice and conversational LLMs. With our Speech Synthesis and Voice Cloning models, we are building the SOTA conversational AI products.

We are building a platform and infrastructure for Conversational AI Voice Agents so that every business, developer, or tinkerer can easily build talking human-like AI agents and use them to serve their customers; this will unlock massive value for the world and a lot of happiness for people using these delightful agents.

We joined YC last year in the YC W23 batch. Since then, we have raised $8m in seed funding and seen significant growth in users and revenue (20x the last two years).

What are we looking for?

We are in search of Full-time MLOps Engineers who are passionate about solving challenging problems and inventing the future of how people interact with LLMs. By joining our team, you have the opportunity to be a founding engineer and play a pivotal role in shaping the future of Conversational AI. If you're keen on pushing AI boundaries and making a significant impact, this role is for you.

Responsibilities:

Designing and building large-scale inference backend for our LLMs.
Take LLMs from research to production-ready and scalable APIs.
Experimenting and improving our Voice LLMs architectures for better quality, and latency.
Enhancing inference infrastructure to reduce costs and latency.

Qualifications:

An autonomous and resourceful engineer with a proven track record in building and deploying large-scale production APIs.
Extensive experience as an MLOps, Platform, or Infra Engineer or similar roles.
Strong background in Backend Software Engineering and building scalable APIs.
Proficiency in cloud computing platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).
Demonstrates a growth mindset and a passion for solving challenging problems.
Experience with Python and C++.
Familiarity with LLM deployments is a significant plus.