Principal Engineer

Our Purpose

At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. With the rise of the internet, trust in AI has been degraded by a plethora of issues like spam, fraudulent transactions, hate speech, and online abuse. Fiddler enables organizations to get ahead of these issues by building trustworthy, transparent, and explainable AI solutions. 

Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. Data Science, MLOps, and business teams use Fiddler AI to monitor, explain, analyze, and improve their AI solutions to identify performance gaps, mitigate bias, and drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the “why” and how behind model outcomes.  

Our Founders

Fiddler AI is founded by Krishna Gade (engineering leadership at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (two-time founder with acquisitions by Samsung and PayPal and product roles at Expedia and Microsoft). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital. 

Why Join Us

Our team is motivated to unlock the AI opaque box and help society harness the power of AI. Joining us means you get to make an impact by helping reduce algorithmic bias and ensure that models in production across many different industries are transparent and ethical.  We are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers, thinkers, creators, builders, and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.  

Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades, including:  2022 a16z Data50 list, 2021 CB Insights AI 100 most promising startups, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space.

The Opportunity

As Principal engineer, you will play a key role in shaping the future of Fiddler’s observability solutions for Machine Learning models,  Large Language Models (LLMs) and Generative AI

In this role, you will be responsible for leading the architecture, design, and implementation of scalable machine learning infrastructure and big data solutions. You will collaborate closely with product teams, data scientists, and software engineers to build robust, high-performing products for enterprise customers. Your expertise in designing large-scale systems, optimizing analytics workflows, and developing innovative machine learning solutions will be crucial in driving the success of our platform.

What You’ll Do

• Lead Architecture & Design: 

  • Architect and design scalable, high-performance systems for supporting advanced MLOps infrastructure, algorithms and model performance monitoring tools to enable enterprise-scale machine learning applications.

  • As part of your role you will be responsible for designing and optimizing ML pipelines, ML model deployment, data ingestion frameworks, big data analytics computations and robust data solutions to process and analyze large-scale datasets efficiently.

• Optimization & Scalability: Ensure solutions are optimized for both speed and scalability, handling high volumes of data and real-time analytics while maintaining system integrity.

• Enterprise Solutioning: Translate customer requirements into technical solutions that are reliable, secure, and compliant with enterprise-grade standards.

• Product Development: Drive the strategy and development of end-to-end ML and analytics products and solutions, from concept through implementation, with a focus on performance, reliability, and user experience.

• Collaboration & Mentorship: Work cross-functionally with product managers, data scientists, and engineers to deliver integrated solutions. Mentor mid-level and senior engineers, fostering a culture of innovation and technical excellence. 

• Engineering excellence: Recommend and implement engineering best practices across the entire engineering organization, improve the functionality of existing software, and ensure that the design, application, and maintenance of our software meets quality standards

• Continuous Improvement: Stay current with the latest trends in machine learning, big data, and cloud technologies. Propose and implement process improvements, new technologies, and best practices.

What We are Looking For

• Experience: 12+ years of hands-on experience in building and deploying machine learning infrastructure, big data analytics solutions, and enterprise software products.

• Education: Academic degree in Computer Science, Data Science, Engineering, or a related field (Master’s or PhD preferred)

• Deep Technical Expertise: 

  • Strong background in distributed systems, big data processing and cloud computing (AWS, GCP, Azure)

  • Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and managing machine learning models in production.

  • Experience in tuning and optimizing  system performance, efficiency, reliability

• Enterprise-Grade Product Development: Proven track record in designing and delivering complex, high-performance solutions for large-scale enterprise customers with fault tolerant architecture and successful handling of compliance and integration aspects.

• Programming Skills: Proficient in Python, with a solid understanding of data structures, algorithms, and best coding practices.

• Data Engineering & Analytics: In-depth experience with data storage technologies (e.g., SQL, NoSQL, Data Lakes), ETL processes, and building real-time data pipelines.

• Leadership: Excellent communication, collaboration, and leadership skills, with the ability to lead teams, mentor engineers, and work with cross-functional groups.

  Nice to Have:

• Experience in setting up, monitoring and tuning ML models and Large language models in production. 

• Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, BERT models, quantization, and eval frameworks like Ragas or Presidio) and MLOps best practices  

• Experience with modern data processing frameworks (e.g., Apache Flink, Apache arrow) 

Compensation and In-Office Policy

• Pay Range in San Francisco Bay Area for this role is $240,000 - $275,000

• Fiddlers who live within 25 miles of the US HQ come at least 2 days/week into the office

• More than 25 miles, once a week in the office

The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package, benefits, and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors.

Fiddler is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.