Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Machine Learning Engineer (Audio) image - Rise Careers
Job details

Machine Learning Engineer (Audio)

About Zyphra

At Zyphra, we're building Maia—a cutting-edge multimodal agent system that combines advanced research in neural network architectures, long-term memory, and reinforcement learning. Based in Palo Alto, our team brings together talent from leading AI organizations including Google DeepMind, Anthropic, StabilityAI, Qualcomm, Neuralink, Nvidia, and Apple.

Machine Learning Engineer (Audio)

About this role:

You will be a core contributor on Zyphra’s Audio Team building the next generation of open-source text-to-speech and audio models. You will be deeply involved in the entire model training process from data gathering and processing to designing novel architectures and training methodologies. You will work across:

  • Large-scale audio training runs

  • Performance optimization of our training stack

  • Audio dataset collection, processing, and evaluation

  • Architecture and training methodology ablations and improvements

While deep expertise in all areas isn't required, you should be enthusiastic about learning each aspect as needed to drive our models forward. We also strongly look for velocity over position. However, having deep expertise in at least one of the above is helpful to begin contributing immediately. 

Requirements:

  • Strong research taste and intuition. The ability to work through a research project from conception to execution to write-up.

  • Strong implementation and prototyping ability – can take an idea from conception to experimentation quickly

  • The ability to work well with others in a high-paced research setting

  • Can rapidly learn new fields and are excited to implement new ideas

  • Excellent communication and collaboration skills and can work effectively on both research and engineering implementation at scale.

Good to have:

  • Expertise and intuition for training models in the audio domain including text-to-speech, ASR, speech-to-speech, speech-emotion-recognition, or other models

  • Experience in training audio autoencoders.

  • Understanding of signal processing especially of audio signals.

  • Experience with diffusion models, consistency models, or GANs

  • Experience with training on large scale (multi-node) GPU clusters

  • Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing

  • Understanding of and interest in large-scale highly parallel data processing pipelines.

  • Proficiency with Pytorch and Python.

  • Experience contributing to large pre-existing codebases and rapidly getting up to speed.

  • Previously published machine learning research in well-respected venues.

  • Postgraduate degree in scientific subject (Computer Science, EE/EECS, Mathematics, Physics, Machine Learning)

Culture:

  • Our research methodology is to make grounded, methodical steps toward ambitious goals. Both deep research and engineering excellence are equally valued

  • We strongly value new and crazy ideas and are very willing to bet big on new ideas

  • We move as quickly as we can; we aim to make the bar to impact as low as possible

  • We all enjoy what we do and love discussing AI

Benefits and Perks:

  • Medical, dental, vision and FSA plans

  • Competitive salary, equity and 401(k)

  • Relocation and immigration support on a case-by-case basis

  • On-site meals prepared by a dedicated culinary team; Thursday Happy Hours 

General requirements:

  • Willing to be in-person in our office in Palo Alto

  • US authorization to work. We will consider O1 visa sponsorship for the right candidate

Average salary estimate

$100000 / YEARLY (est.)
min
max
$80000K
$120000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Machine Learning Engineer (Audio), Zyphra

At Zyphra, we're excited to invite a talented Machine Learning Engineer (Audio) to join our dynamic team in Palo Alto. As a core contributor, you'll play an essential role in building next-gen open-source text-to-speech and audio models as part of our innovative Audio Team. Your journey will involve hands-on participation in the entire model training process, from gathering and processing data to designing unique architectures and training methodologies. You'll dive into large-scale audio training runs, optimize our training stack for better performance, and engage in the evaluation of our audio datasets. While we value diverse expertise across these areas, we're particularly keen on your enthusiasm for learning and pushing the limits of audio technology. We truly believe in velocity over perfection, so a strong foundation in at least one area will have you contributing right from the start. Your robust research intuition and the capability to transition ideas from conception to experimentation rapidly will be vital. This isn't just a job; it's a collaboration in a fast-paced research environment where you'll thrive together with your peers from leading AI organizations. If you're passionate about audio models and eager to tackle challenges head-on, we welcome you to explore this opportunity with us at Zyphra, where innovation meets execution.

Frequently Asked Questions (FAQs) for Machine Learning Engineer (Audio) Role at Zyphra
What responsibilities does a Machine Learning Engineer (Audio) have at Zyphra?

As a Machine Learning Engineer (Audio) at Zyphra, your responsibilities encompass a broad spectrum of tasks including conducting large-scale audio training runs, collecting and processing audio datasets, and optimizing performance within our training stack. You'll also design innovative training methodologies and contribute to architecture improvements, enabling the delivery of cutting-edge text-to-speech and audio models.

Join Rise to see the full answer
What qualifications are required for the Machine Learning Engineer (Audio) role at Zyphra?

To excel as a Machine Learning Engineer (Audio) at Zyphra, candidates should possess a strong research mentality, excellent communication skills, and proficiency with PyTorch and Python. Experience in audio domains such as text-to-speech or speech emotion recognition is beneficial. A postgraduate degree in a relevant field, like Computer Science, is also advantageous for this position.

Join Rise to see the full answer
What kind of work environment can a Machine Learning Engineer (Audio) expect at Zyphra?

At Zyphra, the work environment for a Machine Learning Engineer (Audio) is collaborative and fast-paced, where both research excellence and engineering capabilities are highly valued. The team is passionate about exploring innovative ideas and typical activities include brainstorming sessions, collective problem-solving, and enjoying a culture that celebrates creative thinking.

Join Rise to see the full answer
How does Zyphra support the growth of its Machine Learning Engineers (Audio)?

Zyphra is committed to the professional growth of its Machine Learning Engineers (Audio) by fostering an environment of learning. You will have opportunities to work on ambitious projects that encourage you to quickly learn and implement new methodologies, as well as access to mentoring from experienced peers in a supportive environment, ensuring continuous skill development.

Join Rise to see the full answer
What benefits does Zyphra offer to its Machine Learning Engineer (Audio) team members?

Zyphra offers an attractive benefits package for its Machine Learning Engineers (Audio), including medical, dental, and vision plans, competitive salaries, and equity options. Additional perks include on-site meals, relocation assistance as needed, and an engaging office culture that enriches your overall work experience.

Join Rise to see the full answer
Common Interview Questions for Machine Learning Engineer (Audio)
Can you describe your experience with audio modeling?

In answering this question, focus on any relevant projects or research you've conducted involving audio models, especially in areas like text-to-speech or ASR. Provide specific examples of technologies or frameworks you've used, underlining your hands-on experience and ability to engage deeply with audio processing tasks.

Join Rise to see the full answer
What methodology do you follow for conducting experiments in machine learning?

Explain your approach to experimental design, covering aspects like hypothesis formulation, data collection, model training, and performance evaluation. Highlight your understanding of running rigorous ablation studies and how you apply careful experimental methodology to enhance model performance effectively.

Join Rise to see the full answer
How do you handle challenges while optimizing machine learning models?

Discuss the problem-solving strategies you employ when faced with challenges. Emphasize collaboration, your inclination to research potential solutions, and how you've previously adopted new techniques to overcome barriers in optimizing models, illustrating your ability to adapt and innovate under pressure.

Join Rise to see the full answer
What programming languages and tools are you proficient in for machine learning?

When responding, mention your proficiency in Python and specifically PyTorch as required by Zyphra. Include any additional languages or tools you're comfortable with, explaining how you've leveraged them in previous projects to facilitate efficient model development and data analysis.

Join Rise to see the full answer
How do you stay updated on advancements in machine learning and audio processing?

Share your strategies for staying current with trends and research in machine learning and audio processing, such as following influential publications, participating in workshops, and engaging with online communities or forums. This showcases your dedication to lifelong learning and passion for the field.

Join Rise to see the full answer
Describe a project where you contributed significantly to a machine learning model.

Be specific about your role in the project, detailing the model's objectives, the challenges faced, and your contributions to its development. Highlight how your efforts led to measurable outcomes, demonstrating your impact within a team setting and your capacity for taking initiative.

Join Rise to see the full answer
How do you approach collaboration with team members in a fast-paced research environment?

Illustrate your teamwork skills by sharing examples of how you've successfully collaborated on projects, communicated effectively, and resolved conflicts. Emphasize the importance of open communication and leveraging team strengths to achieve collective goals in a dynamic workspace.

Join Rise to see the full answer
What role does experimentation play in your work as a Machine Learning Engineer?

Stress the significance of experimentation in developing, refining, and validating models. Describe how you approach different experimentation phases, including setting up tests, analyzing results, and iterating on designs based on feedback and performance measurement.

Join Rise to see the full answer
Can you explain how you've dealt with data processing in machine learning projects?

Discuss your experience with data preprocessing, data augmentation, or any techniques you've utilized to prepare data for training machine learning models. Highlight specific tools or libraries and how you've ensured data quality and relevance for the task at hand.

Join Rise to see the full answer
What excites you about working in audio machine learning specifically?

Express your passion for audio machine learning by discussing specific aspects you find compelling, whether it's the challenge of developing natural-sounding speech models or the potential for innovation in audio-driven applications. Share your vision for future advancements in the field and how you hope to contribute.

Join Rise to see the full answer
Similar Jobs

Take the lead in advancing drug discovery as a Senior Machine Learning Scientist at Tahoe Therapeutics, where innovation meets biology.

Photo of the Rise User
AbbVie Hybrid North Chicago, IL, USA
Posted 6 days ago

Join AbbVie as a Senior Data Scientist II to leverage your expertise in data science and machine learning to advance impactful solutions in healthcare.

FAU Hybrid Boca Raton
Posted 7 days ago

Join FAU as a Data Scientist to drive innovation through advanced data analysis and machine learning techniques.

Fulton Bank Remote Lancaster, PA
Posted 3 days ago

We're looking for a skilled Data Scientist to join Fulton Bank and help drive data-driven decision-making across various business initiatives.

Photo of the Rise User
Posted 6 days ago

As a Data Science Intern at GeoComply, you will analyze data and develop solutions to combat online fraud while learning from industry leaders.

Photo of the Rise User
Posted 4 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Bias Training
Employee Resource Groups
401K Matching
Paternity Leave
Maternity Leave
Some Meals Provided
Social Gatherings

As a Data Scientist III at Google, you will leverage your analytical skills to drive product improvements in the advertising domain.

Photo of the Rise User
Discover Hybrid Riverwoods, IL
Posted 17 hours ago

Join Discover to drive the development of innovative predictive models that enhance our digital banking and payments solutions.

Photo of the Rise User
Pearl Health Hybrid No location specified
Posted 6 days ago

Join Pearl Health as a Staff Data Scientist to innovate and enhance healthcare delivery through advanced data science solutions.

MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
HQ LOCATION
No info
EMPLOYMENT TYPE
Full-time, on-site
DATE POSTED
April 22, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
Someone from OH, North Canton just viewed NodeJs developer at BlackStone eIT
Photo of the Rise User
Someone from OH, North Canton just viewed Software Development Engineer - Recent Grads Welcome at Sonos
Photo of the Rise User
Someone from OH, Dayton just viewed Data Entry and Word Processing at MoxieIT
Photo of the Rise User
Someone from OH, Dayton just viewed Content Developer - Intern at Big Ideas Learning
Photo of the Rise User
6 people applied to Data Scientist at Extend
Photo of the Rise User
Someone from OH, Pickerington just viewed Salesforce Lead at Bounteous
Photo of the Rise User
Someone from OH, Pickerington just viewed Industry Lead - High Tech (Salesforce) at Thunder
D
Someone from OH, Akron just viewed Junior Motion Designer at DEPT®
R
Someone from OH, Akron just viewed 2D Graphic and Motion Designer at Ruby Labs
Photo of the Rise User
Someone from OH, Columbus just viewed Customer Success Manager, US SLED at Dataminr
Photo of the Rise User
Someone from OH, Greenville just viewed Systems Engineer (Linux & Shell or Python scripting) at Visa
Photo of the Rise User
Someone from OH, Greenville just viewed Help Desk Technician - Youngstown at R.I.T.A.
Photo of the Rise User
Someone from OH, Mount Orab just viewed Backend Developer at G2i Inc.
Photo of the Rise User
Someone from OH, Cincinnati just viewed Product Marketing Manager at Cast & Crew
Photo of the Rise User
Someone from OH, Cincinnati just viewed Marketing Manager at Cast & Crew
o
Someone from OH, Cincinnati just viewed Administrative Assistant at osu
A
Someone from OH, Cincinnati just viewed Data Entry Clerk at Alphabe Insight Inc
Photo of the Rise User
Someone from OH, Cincinnati just viewed Machine Learning Engineer at Allstate