About Zyphra
At Zyphra, we're building Maia—a cutting-edge multimodal agent system that combines advanced research in neural network architectures, long-term memory, and reinforcement learning. Based in Palo Alto, our team brings together talent from leading AI organizations including Google DeepMind, Anthropic, StabilityAI, Qualcomm, Neuralink, Nvidia, and Apple.
Machine Learning Engineer (Audio)
About this role:
You will be a core contributor on Zyphra’s Audio Team building the next generation of open-source text-to-speech and audio models. You will be deeply involved in the entire model training process from data gathering and processing to designing novel architectures and training methodologies. You will work across:
Large-scale audio training runs
Performance optimization of our training stack
Audio dataset collection, processing, and evaluation
Architecture and training methodology ablations and improvements
While deep expertise in all areas isn't required, you should be enthusiastic about learning each aspect as needed to drive our models forward. We also strongly look for velocity over position. However, having deep expertise in at least one of the above is helpful to begin contributing immediately.
Requirements:
Strong research taste and intuition. The ability to work through a research project from conception to execution to write-up.
Strong implementation and prototyping ability – can take an idea from conception to experimentation quickly
The ability to work well with others in a high-paced research setting
Can rapidly learn new fields and are excited to implement new ideas
Excellent communication and collaboration skills and can work effectively on both research and engineering implementation at scale.
Good to have:
Expertise and intuition for training models in the audio domain including text-to-speech, ASR, speech-to-speech, speech-emotion-recognition, or other models
Experience in training audio autoencoders.
Understanding of signal processing especially of audio signals.
Experience with diffusion models, consistency models, or GANs
Experience with training on large scale (multi-node) GPU clusters
Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing
Understanding of and interest in large-scale highly parallel data processing pipelines.
Proficiency with Pytorch and Python.
Experience contributing to large pre-existing codebases and rapidly getting up to speed.
Previously published machine learning research in well-respected venues.
Postgraduate degree in scientific subject (Computer Science, EE/EECS, Mathematics, Physics, Machine Learning)
Culture:
Our research methodology is to make grounded, methodical steps toward ambitious goals. Both deep research and engineering excellence are equally valued
We strongly value new and crazy ideas and are very willing to bet big on new ideas
We move as quickly as we can; we aim to make the bar to impact as low as possible
We all enjoy what we do and love discussing AI
Benefits and Perks:
Medical, dental, vision and FSA plans
Competitive salary, equity and 401(k)
Relocation and immigration support on a case-by-case basis
On-site meals prepared by a dedicated culinary team; Thursday Happy Hours
General requirements:
Willing to be in-person in our office in Palo Alto
US authorization to work. We will consider O1 visa sponsorship for the right candidate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
At Zyphra, we're excited to invite a talented Machine Learning Engineer (Audio) to join our dynamic team in Palo Alto. As a core contributor, you'll play an essential role in building next-gen open-source text-to-speech and audio models as part of our innovative Audio Team. Your journey will involve hands-on participation in the entire model training process, from gathering and processing data to designing unique architectures and training methodologies. You'll dive into large-scale audio training runs, optimize our training stack for better performance, and engage in the evaluation of our audio datasets. While we value diverse expertise across these areas, we're particularly keen on your enthusiasm for learning and pushing the limits of audio technology. We truly believe in velocity over perfection, so a strong foundation in at least one area will have you contributing right from the start. Your robust research intuition and the capability to transition ideas from conception to experimentation rapidly will be vital. This isn't just a job; it's a collaboration in a fast-paced research environment where you'll thrive together with your peers from leading AI organizations. If you're passionate about audio models and eager to tackle challenges head-on, we welcome you to explore this opportunity with us at Zyphra, where innovation meets execution.
Take the lead in advancing drug discovery as a Senior Machine Learning Scientist at Tahoe Therapeutics, where innovation meets biology.
Join AbbVie as a Senior Data Scientist II to leverage your expertise in data science and machine learning to advance impactful solutions in healthcare.
Join FAU as a Data Scientist to drive innovation through advanced data analysis and machine learning techniques.
We're looking for a skilled Data Scientist to join Fulton Bank and help drive data-driven decision-making across various business initiatives.
As a Data Science Intern at GeoComply, you will analyze data and develop solutions to combat online fraud while learning from industry leaders.
As a Data Scientist III at Google, you will leverage your analytical skills to drive product improvements in the advertising domain.
Join Pearl Health as a Staff Data Scientist to innovate and enhance healthcare delivery through advanced data science solutions.
Subscribe to Rise newsletter