TPU Kernel & Compiler Engineer

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and test-time compute to achieve this goal.

About the role:

As a Kernel/Compiler engineer, you will work on implementing and optimizing our inference stack for Google Cloud TPU using Jax and Pallas.

What you might work on: 

• Design, implement, and optimize compilers for machine learning workloads for TPU to ensure high performance and efficiency

• Work with Google to implement new features for Pallas, their Triton-like kernel compiler, as required for Magic’s workloads

• Develop and maintain tools and infrastructure for TPU inference and training

What we’re looking for: 

• Proven expertise in compiler development or accelerator kernel engineering

• Experience with performance engineering and optimization for HPC and/or AI workloads

• Experience with XLA or Jax

• Outstanding ability to identify and solve complex technical problems related to performance and efficiency

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience. 

Our culture:

• Integrity. Words and actions should be aligned

• Hands-on. At Magic, everyone is building 

• Teamwork. We move as one team, not N individuals

• Focus. Safely deploy AGI. Everything else is noise

• Quality. Magic should feel like magic

Compensation, benefits and perks (US):

• Annual salary range: $150K - $1M

• Equity is a significant part of total compensation, in addition to salary

• 401(k) plan with 6% salary matching

• Generous health, dental and vision insurance for you and your dependants

• Unlimited paid time off

• Option to work in-person in SF or remotely

• Visa sponsorship and relocation stipend to bring you to SF

• A small, fast-paced, highly focused team