About the Company
Our client is a well-funded, early-stage startup on a mission to transform how LLM-based applications are built, observed, and optimized. They're creating a unified platform that brings together inference, observability, evaluation, and optimization — enabling a feedback loop that makes LLM applications smarter, faster, and more cost-effective over time.
The company is backed by top-tier investors who have supported market-defining infrastructure and AI companies. With years of runway and an open-source-first mindset, the team is focused on long-term innovation and impact.
The Role
We’re hiring a Founding Member of Technical Staff to join a deeply technical in-person team based in NYC. In this role, you’ll act as a product-minded engineer working across the stack, contributing to key user-facing components while helping shape foundational architecture for a high-performance LLM infrastructure layer.
You’ll work alongside world-class experts in front-end engineering (React/Remix/Radix), systems engineering (Rust), and machine learning (LLMs, RL, Bayesian ML) to bring developer tools and infrastructure to life.
What You’ll Do
Design and build high-impact features for real-time LLM observability and prompt evaluation
Help develop a unified API for inference across multiple LLM providers and open-weight models
Contribute to open-source tooling, dashboards, and developer-facing workflows
Collaborate on features like A/B testing, fallback routing, model comparisons, and optimization pipelines
Drive projects end-to-end, from prototyping to deployment
What We're Looking For
Strong engineering background with experience across the stack (React, Python, Rust, or equivalent)
Experience building developer tools, ML infrastructure, or LLM-based systems is a big plus
Passion for clean design, developer experience, and product quality
Interest in open-source ecosystems and building in public
Eagerness to work in a fast-paced, high-ownership environment
Available to work in-person full-time in New York City
Why This Role?
Impact – Help define the core product and engineering vision of a breakout infrastructure company
Open Source – Most of your work will be open-source and developer-facing
Team – Work with deeply experienced founders and researchers from Stanford, CMU, FAIR, AWS, and more
Investors – Backed by some of the best in AI and infrastructure investing
Compensation – Competitive salary, meaningful equity, and full benefits
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Exciting opportunity to contribute as an External Wholesaler at a high-growth real estate investment firm focused on DSTs and REITs.
Contribute as a founding Back-end Engineer specializing in Rust to develop cutting-edge infrastructure for optimizing large language model applications in a fast-growing, open-source company based in NYC.
A Software Engineer III role focused on cloud data engineering at JPMorgan Chase, working on scalable data pipelines and secure software solutions.
Contribute to cutting-edge autonomous aerial defense systems as a Senior Software Engineer on Anduril's Tactical Recon and Strike team, enhancing the Anvil platform.
Experienced software engineer with strong Go and Linux skills needed to develop secure, cloud-native Kubernetes distribution products at Replicated's fully remote team.
Collaborate remotely with Mindrift as a freelance Software Developer specializing in Rust to support cutting-edge AI model training and quality assurance.
Contribute as a founding engineer at Keplogic to build innovative AI applications accelerating life sciences research.
U.S. Bank is looking for a skilled Software Engineer 2 experienced in NodeJS and full-stack development to contribute to innovative financial software solutions.
Contribute to AllTrails’ mission by developing impactful frontend features in a fast-paced, remote Growth team focused on enhancing user journeys and engagement.
A Principal UI Engineer role at Esri focusing on advancing the Calcite design system and promoting UI consistency across products in a remote work environment.
Peraton seeks a skilled Mainframe Telecom Systems Software Engineer to lead software projects and support mainframe payroll applications remotely.
Angel Studios is seeking a Senior Software Engineer specialized in Roku development to craft exceptional user experiences on their media platform.
Contribute to Nordstrom's restaurant technology by developing and scaling their POS and labor management systems as a Software Development Engineer 2.
Contribute as a full stack engineer at Mixpanel, crafting intuitive analytics tools that empower thousands of customers to make better decisions.
A dynamic Junior Full-Stack Developer role at abra R&D Solutions focusing on Node.js backend and React frontend development.
Subscribe to Rise newsletter