Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Full Stack Engineer (LLM Infrastructure & Developer Tooling) image - Rise Careers
Job details

Full Stack Engineer (LLM Infrastructure & Developer Tooling)

About the Company
Our client is a well-funded, early-stage startup on a mission to transform how LLM-based applications are built, observed, and optimized. They're creating a unified platform that brings together inference, observability, evaluation, and optimization — enabling a feedback loop that makes LLM applications smarter, faster, and more cost-effective over time.

The company is backed by top-tier investors who have supported market-defining infrastructure and AI companies. With years of runway and an open-source-first mindset, the team is focused on long-term innovation and impact.

The Role
We’re hiring a Founding Member of Technical Staff to join a deeply technical in-person team based in NYC. In this role, you’ll act as a product-minded engineer working across the stack, contributing to key user-facing components while helping shape foundational architecture for a high-performance LLM infrastructure layer.

You’ll work alongside world-class experts in front-end engineering (React/Remix/Radix), systems engineering (Rust), and machine learning (LLMs, RL, Bayesian ML) to bring developer tools and infrastructure to life.

What You’ll Do

  • Design and build high-impact features for real-time LLM observability and prompt evaluation

  • Help develop a unified API for inference across multiple LLM providers and open-weight models

  • Contribute to open-source tooling, dashboards, and developer-facing workflows

  • Collaborate on features like A/B testing, fallback routing, model comparisons, and optimization pipelines

  • Drive projects end-to-end, from prototyping to deployment

What We're Looking For

  • Strong engineering background with experience across the stack (React, Python, Rust, or equivalent)

  • Experience building developer tools, ML infrastructure, or LLM-based systems is a big plus

  • Passion for clean design, developer experience, and product quality

  • Interest in open-source ecosystems and building in public

  • Eagerness to work in a fast-paced, high-ownership environment

  • Available to work in-person full-time in New York City

Why This Role?

  • Impact – Help define the core product and engineering vision of a breakout infrastructure company

  • Open Source – Most of your work will be open-source and developer-facing

  • Team – Work with deeply experienced founders and researchers from Stanford, CMU, FAIR, AWS, and more

  • Investors – Backed by some of the best in AI and infrastructure investing

  • Compensation – Competitive salary, meaningful equity, and full benefits

Average salary estimate

$125000 / YEARLY (est.)
min
max
$100000K
$150000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
AlphaHire Hybrid Pasadena, California, United States
Posted 12 days ago

Exciting opportunity to contribute as an External Wholesaler at a high-growth real estate investment firm focused on DSTs and REITs.

AlphaHire Hybrid New York, New York, United States
Posted 11 days ago

Contribute as a founding Back-end Engineer specializing in Rust to develop cutting-edge infrastructure for optimizing large language model applications in a fast-growing, open-source company based in NYC.

A Software Engineer III role focused on cloud data engineering at JPMorgan Chase, working on scalable data pipelines and secure software solutions.

Photo of the Rise User
Anduril Industries Hybrid Costa Mesa, California, United States
Posted 6 days ago

Contribute to cutting-edge autonomous aerial defense systems as a Senior Software Engineer on Anduril's Tactical Recon and Strike team, enhancing the Anvil platform.

Photo of the Rise User

Experienced software engineer with strong Go and Linux skills needed to develop secure, cloud-native Kubernetes distribution products at Replicated's fully remote team.

Collaborate remotely with Mindrift as a freelance Software Developer specializing in Rust to support cutting-edge AI model training and quality assurance.

Photo of the Rise User

Contribute as a founding engineer at Keplogic to build innovative AI applications accelerating life sciences research.

Photo of the Rise User
Posted 17 hours ago

U.S. Bank is looking for a skilled Software Engineer 2 experienced in NodeJS and full-stack development to contribute to innovative financial software solutions.

Photo of the Rise User
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Casual Dress Code
Collaboration over Competition
Fast-Paced
Rapid Growth
Social Impact Driven
Passion for Exploration
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Learning & Development
Life insurance
Dental Insurance
Vision Insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)

Contribute to AllTrails’ mission by developing impactful frontend features in a fast-paced, remote Growth team focused on enhancing user journeys and engagement.

Photo of the Rise User
Esri Hybrid Remote Eligible, US
Posted 13 days ago

A Principal UI Engineer role at Esri focusing on advancing the Calcite design system and promoting UI consistency across products in a remote work environment.

Photo of the Rise User

Peraton seeks a skilled Mainframe Telecom Systems Software Engineer to lead software projects and support mainframe payroll applications remotely.

Photo of the Rise User

Angel Studios is seeking a Senior Software Engineer specialized in Roku development to craft exceptional user experiences on their media platform.

Photo of the Rise User
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Empathetic
Feedback Forward
Take Risks
Casual Dress Code
Startup Mindset
Emails over Meetings
Collaboration over Competition
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Mixe-Ability Accomodations
Performance Bonus
Fully Distributed
Family Medical Leave
Child Care stipend
Onsite Child Care
Vision Insurance
Dental Insurance
Life insurance
Disability Insurance

Contribute to Nordstrom's restaurant technology by developing and scaling their POS and labor management systems as a Software Development Engineer 2.

Photo of the Rise User
Mixpanel Hybrid San Francisco, California, United States
Posted 7 days ago

Contribute as a full stack engineer at Mixpanel, crafting intuitive analytics tools that empower thousands of customers to make better decisions.

Abra Hybrid Brooklyn Center, Minnesota, United States
Posted 20 hours ago

A dynamic Junior Full-Stack Developer role at abra R&D Solutions focusing on Node.js backend and React frontend development.

MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
HQ LOCATION
No info
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
May 2, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!