Senior Research engineer - Multimodal Language Models
Luma’s mission is to build multimodal AI to expand human imagination and capabilities.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
We are looking for engineers with significant experience solving hard problems in PyTorch, multimodal data, and distributed systems. You will work as a team to end-to-end build cutting edge multimodal language models with strong emphasis on audio and visual data. Your contributions will be pivotal in shaping various research projects and product roadmaps.
Responsibilities
Design and develop large-scale annotation efforts for model post-training.
Build tools to evaluate and benchmark multimodal language models.
Develop large-scale AI training and inference methods.
Ensure efficient implementation of models & systems for data processing and training.
Build tools to visualize, evaluate and filter datasets.
Collaborate with research and engineering teams across Luma to transfer research to products and services.
Implement cutting-edge product prototypes based on multimodal generative AI.
Experience
Expertise in Python & Pytorch, including practical experience working with the full development pipeline from data processing, preparation & data loading to training and inference.
Experience processing large-scale text data, or (bonus) interleaved data spanning audio, video, image, and/or text.
Hands-on experience in developing or benchmarking at least one of the following topics: LLMs, Vision Language Models, Audio Language Models, generative video models.
Good to have
Experience in design and development of annotation tools
Experience in synthetic data
Compensation
The pay range for this position in California is $200,000 - $300,000/yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan.
Your application is reviewed by real people.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Luma seeks a seasoned Business Development Executive to revolutionize agency partnerships with cutting-edge AI technology.
Become a key player at Luma AI as a Business Development Executive, driving innovative brand partnerships in the evolving AI landscape.
Become an integral part of Eurofins EAG Laboratories as a Scientist specializing in Transmission Electron Microscopy, delivering expert analysis to tech clients.
Join Clean Earth as a Senior Chemist and lead our quality control laboratory in contributing to environmental sustainability.
Bristol Myers Squibb seeks an experienced Immunohistochemistry Scientist to drive innovative biomarker assay development in a collaborative lab environment.
Become a key player in AbbVie's Discovery Biotherapeutics team as a Senior Scientist utilizing AI/ML for innovative protein design.
Join Bristol Myers Squibb as an Assistant Scientist, where you can make meaningful contributions to life-changing therapies.
Be a part of Novartis' innovative team as an Innovation Postdoctoral Fellow, where your work will drive advancements in siRNA chemistry and drug discovery.
AbbVie is looking for a Medical Director in Clinical Development to lead clinical trials in neuroscience and contribute to innovative healthcare solutions.
Join Children’s Mercy as a Research - Informatics Applications Analyst to support impactful clinical technologies in a compassionate pediatric healthcare environment.
A pivotal role in shaping the future of automobile user experience at Hyundai America Technical Center, Inc. as a User Experience (UX) Researcher.
Bristol Myers Squibb is seeking an Associate Scientist to enhance cell therapy product development with lab-based expertise.
Lead the development of AI operational solutions at ServiceNow, transforming how enterprises work through innovative technologies.
Join Argonne National Laboratory as a Postdoctoral Appointee to advance deep learning applications in physical sciences through innovative research.
Join AbbVie as a Senior Medical/Scientific Director to guide medical affairs for Blastic Plasmacytoid Dendritic Cell Neoplasm.
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
