Senior Software Engineer

As a Senior Software Engineer at METR, you will be responsible for developing and implementing task evaluations that assess the potential risks posed by AI models. This includes creating and maintaining the infrastructure for testing, standardizing processes for quality assurance, and collaborating with both engineers and researchers to identify areas for improvement in our workflows. Your role will also involve implementing data workflows for effective reporting, so a strong grasp of both software engineering and data analysis will be essential.

To qualify for the Senior Software Engineer position at METR, candidates should have a minimum of 7 years of professional experience in software development, along with deep expertise in asynchronous Python applications. We also consider equivalent expertise demonstrated through open-source contributions or a strong portfolio. Technical proficiency in TypeScript, Docker, Kubernetes, and cloud infrastructure is highly valued, alongside a keen understanding of workflow automation and third-party integrations.

METR offers a motivated and fast-paced work environment that fosters innovation and collaboration. Our team consists of around 20 dedicated individuals who are passionate about AI safety and research. The organization emphasizes diversity and equal opportunity, creating a welcoming space for all qualified candidates. The role is based out of our beautiful co-working space in Berkeley, CA, promoting a culture of teamwork and hands-on learning experiences.

At METR, the Senior Software Engineer plays a key role in advancing AI safety by developing scientific methods and rigorous evaluations that assess AI model capabilities. Your work will directly contribute to ensuring that frontier AI technologies are developed responsibly, through partnerships with industry leaders and government agencies. By refining our evaluation processes and improving the technology behind them, you'll help set an industry standard for AI risk assessment and management.

The compensation range for the Senior Software Engineer position at METR is between $240,558 and $318,138 per year, accompanied by a comprehensive benefits package. We offer competitive salaries and are committed to ensuring that our employees feel valued and rewarded for their contributions, setting the stage for long-term growth and satisfaction within our team.

In your response, highlight specific projects where you utilized asynchronous programming in Python. Describe the challenges you faced and how you overcame them, emphasizing any unique solutions you implemented. Give concrete examples of how your experience aligns with the needs of METR, showing your ability to code and deliver high-quality applications under pressure.

When answering, focus on a specific project where you successfully utilized Docker or Kubernetes for containerization or orchestration. Discuss the objectives of the project, your role, and the results achieved. Highlight any best practices you followed and how these tools complemented the project's goals, showcasing your technical expertise that METR would value.

Discuss your approach to task management, including any tools or methodologies you use, such as Agile or Kanban. Give examples of how you’ve effectively prioritized tasks based on urgency, importance, and team needs. Share how communication skills play a crucial role in managing expectations and delivering quality results on time, which is essential at METR.

Provide an overview of your experience in data engineering, focusing on specific tools and technologies you have used. Discuss your familiarity with data pipelines, versioning, and analysis methods. Illustrate your understanding with a real-life example of a project where you had to analyze data for reporting, showcasing how this skill aligns with the responsibilities at METR.

In your answer, choose a scenario where effective communication was crucial. Describe how you simplified technical concepts without losing important details, focusing on the techniques you used to engage your audience. Highlight your ability to bridge the gap between technical and non-technical colleagues, a skill that is essential for collaboration at METR.

Articulate your understanding of METR's mission in AI safety and the importance of rigorous evaluations. Connect your skills and experiences to specific aspects of the mission, showing a genuine interest in the organization's work. Discuss how your proactive mindset and technical capabilities make you a strong candidate for contributing effectively to METR's goals.

Share a detailed account of a challenging problem, focusing on the context, the specific issue, and the solution you implemented. Emphasize the thought process and methods you used to arrive at the solution, demonstrating your analytical and problem-solving skills. Relate this experience back to the innovative challenges you may encounter at METR.

Outline your approach to test-driven development and the benefits it brings to software quality. Share specific methodologies or techniques you’ve employed in your projects, including any tools or frameworks you prefer. Highlight how your commitment to testing aligns with METR's standards for code quality and reliability.

Discuss your strategies for staying updated, such as attending conferences, participating in online courses, or engaging in professional communities. Share how you actively seek out new knowledge and innovations in the field, demonstrating your enthusiasm for continuous learning, a quality that METR values highly.

Provide examples of your experience with workflow automation tools and integration techniques. Discuss specific projects where you’ve streamlined processes, improved efficiency, or integrated third-party systems. Highlight the impact of these strategies on project outcomes, reflecting on how these experiences could benefit METR's operations.