Job details

DevOps Infrastructure Engineer

Get a free resume review

About Etched

Etched is building AI chips that are hard-coded for individual model architectures. Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower latency than a B200. With Etched ASICs, you can build products that would be impossible with GPUs, like real-time video generation models and extremely deep chain-of-thought reasoning.

DevOps Infrastructure Engineer

Designing and writing software for new ASICs is hard, and requires a huge amount of software and tooling. It is even more challenging for model-specific ASICs, as it is important for them to hit the market at the right time, and thus moving fast is essential.

You will drive adoption of cutting-edge tooling, to improve the speed and reliability of our toolchains. You will help us innovate to do better than the industry norm, by running massively parallel CI jobs, specifying and building our own fully-redundant SSD-only server infrastructure, and making sure these tools run automatically and reliability.

You will work with an IT contracting firm to do the day-to-day maintenance and installation - while you must be knowledgeable enough about IT to work with this firm, most of your time will be spent designing new toolchains entirely

The scope and title of this role can be modified for exceptional candidates.

Representative projects

● Spec out a server using a 6 GHz desktop CPU to speed up single-threaded workloads

● Decide if moving our servers to the cloud/a colo facility makes sense to improve uptime

● Set up networking infrastructure to allow Jupyter notebook users to connect to our

servers, without waiting for them to be restarted.

● Parallelize our CI stack to run on dozens of different machines at once, designing a

policy to avoid unnecessary CI failures if a machine goes down.

You may be a good fit if you

● Are highly technical

● Strong knowledge of Linux, containerization, CI/CD, and programming languages such

as Python/C++. You will be asked coding questions during your interview.

● Proven ability to lead technical teams and mentor junior members

● Have 4+ years of experience with either infrastructure engineering or software

development

● Experience debugging complex hardware and software issues with server infrastructure

Strong candidates may also have experience with

● In-depth understanding of workflows used in the semiconductor industry, especially those involving Synopsys and Cadence EDA tooling and Verilator

● Proficiency with cloud computing technology and experience working with a Big 3 Cloud

● Experience monitoring and installing datacenter hardware

● In-depth understanding of workflows used in the semiconductor industry,

We encourage you to apply even if you do not believe you meet every single qualification.

How we’re different:

Etched believes in the Bitter Lesson. We think most of the progress in the AI field has come from using more FLOPs to train and run models, and the best way to get more FLOPs is to build model-specific hardware. Larger and larger training runs encourage companies to consolidate around fewer model architectures, which creates a market for single-model ASICs.

We are a fully in-person team in Cupertino, and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both as needed.

Benefits:

Full medical, dental, and vision packages, with 100% of premium covered, 90% for dependents
Housing subsidy of $2,000/month for those living within walking distance of the office
Daily lunch and dinner in our office
Relocation support for those moving to Cupertino

What You Should Know About DevOps Infrastructure Engineer, Etched

Joining Etched as a DevOps Infrastructure Engineer means stepping into an exciting world where innovation is at the forefront of AI chip development. At Etched, we specialize in creating AI chips designed for specific model architectures, with our first product, Sohu, boasting unparalleled throughput and latency that outshines traditional offerings. Your role will be vital in developing new software tools and infrastructure to support our cutting-edge ASICs. You'll be developing and managing robust CI pipelines while ensuring reliability across our SSD-only server infrastructure. As a DevOps Infrastructure Engineer, your creative problem-solving skills will shine as you navigate projects like optimizing server specifications and creating networking solutions that eliminate downtime. With your strong tech background in areas like Linux, containerization, and programming languages such as Python and C++, you’ll be at the helm of driving advanced tooling and techniques to propel our product development to new heights. You’ll collaborate with an IT contracting firm for day-to-day operations but will primarily focus on innovating new workflows that keep us ahead in the semiconductor industry. We believe in fostering talent, and our fully in-person team in Cupertino allows for seamless collaboration and brainstorming sessions that enhance our research and engineering capabilities. So if you’re looking to make a real impact in a collaborative environment that values technical skill and team contributions, jump in and explore this unique opportunity with us at Etched.

Frequently Asked Questions (FAQs) for DevOps Infrastructure Engineer Role at Etched

What are the main responsibilities of a DevOps Infrastructure Engineer at Etched?

As a DevOps Infrastructure Engineer at Etched, you will focus on designing and implementing software tools to support our advanced ASIC development. Responsibilities include running parallel CI jobs, creating a fully-redundant SSD-only server infrastructure, and streamlining CI processes to improve the reliability of our toolchains. Additionally, you’ll oversee collaboration with IT contracting firms for routine maintenance while dedicating your expertise towards innovative toolchain development unique to model-specific hardware.