Senior Software Engineer, GenAI & ML Evaluation Frameworks - Grafana Ops, AI/ML (Remote, USA)
Skills
- Experience in evaluation frameworks for AI/ML systems
- Familiarity with prompt engineering and structured output evaluation
- Ability to work in rapid iteration and experimental environments
- Strong collaboration and translation of team goals into testable criteria
Responsibilities
- Design and implement robust evaluation frameworks for GenAI and LLM-based systems
- Develop tooling for automated evaluation of model outputs and prompts
- Define metrics aligning with product goals and operational constraints
- Lead dataset management processes and guide best practices for evaluation
Education
- Bachelor's degree in Computer Science, Engineering, or related field
Benefits
- Equity participation
- Bonus opportunities
- Comprehensive health benefits
- Flexible work hours
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Contribute as a Frontend Engineer at Grafana Labs to build customer-focused observability tools for improved system reliability in a dynamic remote team setting.
Lead the development and strategy of Grafana Labs' Database Observability product, driving innovation and customer-focused solutions within a fully remote, dynamic team.
Seeking a Senior Software Engineer to lead full stack development and enhance innovative healthcare technology at Courier Health.
Software engineering internship at Susquehanna offering hands-on experience building advanced trading systems in a collaborative, growth-oriented environment.
Hebbia is looking for a skilled Frontend Engineer to create engaging, personalized interfaces powering AI-driven knowledge solutions in their NYC office.
Lead the engineering of Roblox's next-generation wallet system to power seamless currency transactions within a global digital marketplace.
Lead engineering efforts at Sharp Performance as Head of Engineering, driving product excellence and team growth in a mission-driven startup.
Contribute to pioneering AI and Machine Learning features as an iOS/macOS Engineer within Apple's innovative Apple Intelligence team.
Contribute as a Senior Frontend Engineer at Zip, creating scalable tooling and frameworks that accelerate development and enhance user experience for a leading procurement platform.
Join Kouper Health as a Senior Full-Stack Engineer to lead backend and MLOps system architecture in a fast-paced, mission-focused healthcare startup.
Palo Alto Networks is hiring a Principal Software Engineer to advance virtualization and cloud network security in a fast-paced innovative environment.
A Junior Software Engineer role at Reevo Inc. to build innovative, scalable software solutions redefining the B2B sales tech landscape.
Contribute to Otter.ai's innovative Android app as a Software Engineer, driving feature development and delivering impactful mobile-first solutions.
Augeo is recruiting an experienced Principal Software Engineer to lead software architecture and development, fostering innovation and mentoring within a hybrid work model.
Innovate with AMD as an AI framework software development engineer driving performance improvements and cutting-edge technology integration.
Grafana Labs is the company behind Grafana, Loki, Mimir and Tempo, the leading open source software for visualizing operational data.
240 jobs
Subscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
