Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
ML Compiler Engineer, Staff image - Rise Careers
Job details

ML Compiler Engineer, Staff

d-Matrix has fundamentally changed the physics of memory-compute integration with our digital in-memory compute (DIMC) engine. The “holy grail” of AI compute has been to break through the memory wall to minimize data movements. We’ve achieved this with a first-of-its-kind DIMC engine. Having secured over $154M, $110M in our Series B offering, d-Matrix is poised to advance Large Language Models to scale Generative inference acceleration with our chiplets and In-Memory compute approach. We are on track to deliver our first commercial product in 2024. We are poised to meet the energy and performance demands of these Large Language Models. The company has 100+ employees across Silicon Valley, Sydney and Bengaluru.

Our pedigree comes from companies like Microsoft, Broadcom, Inphi, Intel, Texas Instruments, Lucent, MIPS and Wave Computing. Our past successes include building chips for all the cloud hyperscalers globally - Amazon, Facebook, Google, Microsoft, Alibaba, Tencent along with enterprise and mobile operators like China Mobile, Cisco, Nokia, Ciena, Reliance Jio, Verizon, AT&AT. We are recognized leaders in the mixed signal, DSP connectivity space, now applying our skills to next generation AI.  

Location:

Hybrid, working onsite at our Mysore / Bangalore, India 3 days per week.

The role: ML Compiler Engineer, Staff

What you will do:

The d-Matrix compiler team is looking for exceptional candidates to help develop the compiler backend - specifically the problem of assigning hardware resources in a spatial architecture to execute low level instructions. The successful candidate will be motivated, capable of solving algorithmic compiler problems and interested in learning intricate details of the underlining hardware and software architectures. The successful candidate will join a team of experienced compiler developers, which will be guiding the candidate for a quick ramp up in the compiler infrastructure, in order to attack the important problem of mapping low level instructions to hardware resources. We have opportunities specifically in the following areas: 

  • Model partitioning (pipelined, tensor, model and data parallelism), tiling, resource allocation, memory management, scheduling and optimization (for latency, bandwidth and throughput).

What you will bring:

Minimum:

  • Bachelor's degree in Computer Science with 7+ Yrs of relevant industry experience, MSCS Preferred with 5+ yrs of relevant industry experience.

  • Ability to deliver production quality code in modern C++. 

  • Experience in modern compiler infrastructures, for example: LLVM, MLIR. 

  • Experience in machine learning frameworks and interfaces, for example: ONNX, TensorFlow and PyTorch.

  • Experience in production compiler development. 

Preferred:

  • Algorithm design ability, from high level conceptual design to actual implementation.

  • Experience with relevant Open Source ML projects like Torch-MLIR, ONNX-MLIR, Caffe, TVM.

  • Passionate about thriving in a fast-paced and dynamic startup culture.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.

d-Matrix Glassdoor Company Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
d-Matrix DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of d-Matrix
d-Matrix CEO photo
Unknown name
Approve of CEO
What You Should Know About ML Compiler Engineer, Staff, d-Matrix

At d-Matrix, we’re on the cutting edge of AI compute with our revolutionary digital in-memory compute (DIMC) engine, and as a Staff ML Compiler Engineer, you’ll have the unique opportunity to play a key role in our mission. Based in Bangalore, you’ll join a team of brilliant minds that are dedicated to tackling the challenge of mapping low-level instructions to hardware resources. Your work will focus on developing the backend of the compiler, where you’ll delve into areas like model partitioning, memory management, and resource allocation. We’re particularly excited to meet someone who loves the depth and detail of intricate hardware and software architectures. With over $154M raised and a talented team consisting of veterans from tech giants like Microsoft and Intel, we’re positioned to co-create innovative solutions for the next generation of AI, aimed at breaking through the memory wall that has long challenged AI compute. We’re fostering a hybrid work culture that allows flexibility while maintaining strong collaboration. If you’re driven, skilled in modern C++, and have experience with LLVM or MLIR, we can’t wait to see what you can achieve with us. Join us as we introduce our first commercial product in 2024, and let's accelerate Generative inference together!

Frequently Asked Questions (FAQs) for ML Compiler Engineer, Staff Role at d-Matrix
What are the responsibilities of a Staff ML Compiler Engineer at d-Matrix?

As a Staff ML Compiler Engineer at d-Matrix, your primary responsibility will be developing the compiler backend. This entails solving algorithmic compiler problems and optimizing the assignment of hardware resources to execute low-level instructions effectively. You'll be working closely with experienced compiler developers, focusing on model partitioning, memory management, and scheduling optimization to enhance performance and bandwidth through our innovative DIMC engine.

Join Rise to see the full answer
What qualifications are needed for the Staff ML Compiler Engineer role at d-Matrix?

To qualify for the Staff ML Compiler Engineer position at d-Matrix, candidates should hold a Bachelor's degree in Computer Science and have at least 7 years of relevant industry experience, or an MSCS with 5 years of experience. Proficiency in modern C++ and familiarity with compiler infrastructures like LLVM or MLIR is essential. Experience with machine learning frameworks such as ONNX, TensorFlow, or PyTorch is also valuable.

Join Rise to see the full answer
How does working as a Staff ML Compiler Engineer at d-Matrix differ from other companies?

Working as a Staff ML Compiler Engineer at d-Matrix offers a unique experience due to our focus on breaking through the memory wall in AI compute. You will be involved in critical research and development that directly impacts large language models, unlike in more traditional settings. Our dynamic startup culture fosters innovation, and you will have the chance to work alongside experts from top tech companies, as well as contribute to cutting-edge projects that aim to revolutionize AI deployments.

Join Rise to see the full answer
What skills are preferred for a Staff ML Compiler Engineer at d-Matrix?

While a strong foundation in modern C++ and compiler infrastructures is a must for the Staff ML Compiler Engineer role at d-Matrix, preferred skills include algorithm design capability from conceptualization to implementation, and experience with open-source ML projects like Torch-MLIR and ONNX-MLIR. A passion for thriving in a fast-paced and dynamic environment is also highly valued as we work towards ambitious goals together.

Join Rise to see the full answer
Can you describe the work culture for the Staff ML Compiler Engineer at d-Matrix?

At d-Matrix, we pride ourselves on maintaining an inclusive and supportive work culture. As a Staff ML Compiler Engineer, you’ll experience a hybrid workspace, fostering collaboration while allowing for flexibility. We value humility, expertise, kindness, and a willingness to embrace challenges. Our team is collaborative, encouraging knowledge-sharing and continuous learning to ensure everyone can contribute their best work and grow within the company.

Join Rise to see the full answer
Common Interview Questions for ML Compiler Engineer, Staff
What experiences do you have with compiler development?

When answering this question, be specific about your previous roles where you were involved in compiler development. Highlight your contributions, the challenges you faced, and the technologies you used, such as LLVM or MLIR. Don’t forget to explain how this experience will help you be successful as a Staff ML Compiler Engineer at d-Matrix.

Join Rise to see the full answer
Can you explain how you would handle optimizing memory management for AI models?

For this question, discuss your understanding of memory management within AI contexts, such as techniques for reducing latency or maximizing throughput. Provide examples from your past experience where you implemented these optimization techniques, and stress your eagerness to apply this knowledge at d-Matrix to enhance our DIMC engine's efficiency.

Join Rise to see the full answer
What is your approach to collaborating with hardware engineers?

To effectively address this question, share your strategies for strong communication and teamwork with hardware engineers. Discuss any previous collaborations, techniques you employed to bridge understanding between software and hardware design, and how this synergy is essential for the Staff ML Compiler Engineer role at d-Matrix.

Join Rise to see the full answer
Discuss your experience with ML frameworks like TensorFlow or PyTorch.

When responding, focus on specific projects where you’ve utilized frameworks such as TensorFlow or PyTorch. Describe how you contributed to projects, the challenges you faced, and what you learned from integrating these frameworks into compiler designs or optimization processes relevant to d-Matrix's goals.

Join Rise to see the full answer
How do you stay current with advancements in compiler technologies?

Highlight your commitment to continuous learning by detailing the resources you regularly consult—such as webinars, academic journals, and community discussions. Mention any conferences or workshops you attend and how staying updated with advancements in compiler technologies will directly benefit your role as a Staff ML Compiler Engineer at d-Matrix.

Join Rise to see the full answer
Can you describe a complex algorithm you've designed?

This question is an opportunity to showcase your problem-solving skills. Discuss the specific challenge you addressed and the thought process behind your algorithm design. Be sure to mention any tools, methodologies, or programming languages you used and explain how this experience will be useful in your role at d-Matrix.

Join Rise to see the full answer
How do you prioritize tasks in a fast-paced environment?

When answering, detail your approach to task prioritization, emphasizing how you assess urgency and impact. Use examples from previous roles to illustrate your effectiveness in managing tasks under pressure and your ability to adapt to changing priorities, particularly in an innovative setting like d-Matrix.

Join Rise to see the full answer
What motivates you in your work as a compiler engineer?

Express what truly drives your passion for compiler engineering. It could be seeing your optimizations lead to performance improvements, working on cutting-edge technologies, or being part of a collaborative environment. Relate your motivations to the mission and vision of d-Matrix to show alignment with the company's culture.

Join Rise to see the full answer
Give an example of how you approached a significant technical challenge.

When addressing this question, provide a detailed example from your experience that showcases your analytical skills, perseverance, and problem-solving abilities. Discuss the actions you took, the outcomes, and the lessons learned that could be impactful as a Staff ML Compiler Engineer at d-Matrix.

Join Rise to see the full answer
What unique skills do you bring to the Staff ML Compiler Engineer role at d-Matrix?

This is your chance to differentiate yourself. Discuss your unique blend of skills—perhaps your cross-functional knowledge in both hardware and software or your experience in optimizing AI models at scale. Clearly articulate how these skills will support d-Matrix’s ambition in advancing AI compute technology.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Deputy Remote No location specified
Posted 4 days ago
SWATX Remote No location specified
Posted 6 days ago
Photo of the Rise User
Posted 11 days ago
Startup Mindset
Collaboration over Competition
Growth & Learning
Inclusive & Diverse
Photo of the Rise User
Posted 13 days ago
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
December 28, 2024

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!