Job details

Research Engineer (Pre-training & Post-training)

Job title: Research Engineer (Pre-training & Post-training) / Member of Technical Staff

Who We Are
WaveForms AI is an Audio Large Language Models (LLMs) company building the future of audio intelligence through advanced research and products. Our models will transform human-AI interactions making them more natural, engaging and immersive.

Role overview: The Research Engineer – Pre-training & Post-training role integrates responsibilities across all phases of the AI model lifecycle, including pre-training, post-training, and data preparation. This position involves building and optimizing large-scale data pipelines, handling multimodal datasets (audio and text), conducting pre-training with a focus on compute efficiency and scalability, and refining models with cutting-edge techniques like supervised fine-tuning (SFT), reinforcement learning from human feedback (RLHF) and generative modeling. The ideal candidate will leverage advanced methods, including GANs and diffusion models, to push the boundaries of multimodal AI systems focused on audio and text.

Key Responsibilities

Lead the pre-training and fine-tuning of large-scale language models (LLMs), maximizing compute efficiency and scaling infrastructure.
Optimize model performance using advanced techniques, including RLHF, reward modeling (RM), instruction-tuning, distillation, GANs, and diffusion models.
Develop robust evaluation pipelines to monitor, refine, and improve model performance throughout training phases.
Build and optimize scalable, distributed data pipelines to support multimodal (audio + text) AI training.
Handle and process massive datasets (PiB scale) for pre-training and post-training, ensuring efficient preparation, annotation, and data flow.
Collaborate with research and engineering teams to ensure seamless integration of data preparation and training workflows for multimodal systems.

Required Skills & Qualifications

Proven experience in training large language models (LLMs), including pre-training, fine-tuning, and post-training optimization.
Strong background in distributed systems, compute efficiency, and scaling model training infrastructure.
Expertise in designing and managing large-scale, distributed data pipelines for multimodal datasets, particularly audio + text.
Proficiency in advanced techniques such as RLHF, instruction-tuning, reward modeling, distillation, GANs, and diffusion models.
Proficiency in Python, PyTorch, and distributed frameworks (e.g., Fully Sharded Data Parallel)
Familiarity with cloud platforms like AWS, GCP, or Azure for managing distributed environments.
Knowledge of multimodal AI systems combining audio and text for training and evaluation.

What You Should Know About Research Engineer (Pre-training & Post-training), WaveForms AI

At WaveForms AI, we are on a mission to revolutionize the field of audio intelligence, and we're looking for a talented Research Engineer (Pre-training & Post-training) to join our team. As a vital member of the technical staff, you'll immerse yourself in every phase of the AI model lifecycle, from the exciting stages of pre-training to the impactful work of post-training. Your role will involve building and optimizing large-scale data pipelines that efficiently handle multimodal datasets, combining audio and text. With a focus on maximizing compute efficiency and scalability, you'll conduct pre-training and refine our models using cutting-edge techniques like supervised fine-tuning and reinforcement learning from human feedback. We're particularly enthusiastic about candidates who can harness advanced methods, including GANs and diffusion models, to push the boundaries of what multimodal AI systems can achieve. In this collaborative environment, you'll work alongside brilliant researchers and engineers, making meaningful contributions to the training workflows that drive our innovative products. If you have a passion for AI and are excited to tackle challenges at the intersection of audio and text, this is the perfect opportunity for you to shine at WaveForms AI.

Frequently Asked Questions (FAQs) for Research Engineer (Pre-training & Post-training) Role at WaveForms AI

What are the main responsibilities of a Research Engineer (Pre-training & Post-training) at WaveForms AI?

As a Research Engineer (Pre-training & Post-training) at WaveForms AI, you'll be tasked with leading the pre-training and fine-tuning of large-scale language models (LLMs). Your responsibilities will also include optimizing model performance using advanced techniques, developing evaluation pipelines, and ensuring the seamless integration of data preparation and training workflows for multimodal systems.