Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Software Engineer - AI Workflows image - Rise Careers
Job details

Software Engineer - AI Workflows

About Flume Health

Flume Health is a software company that connects the fragmented healthcare data ecosystem for more efficient health plan administration. As a single, cloud-native integration platform, Flume’s Relay platform allows companies to easily connect various systems and vendors for efficient data exchange that’s increasingly demanded of the modern health plan. Payers, third-party administrators, prescription benefits managers, and health solutions are provided the simplicity, speed, and security they need to automate data integration and movement between relevant stakeholders. Relay supports multiple data transmission protocols, data types, and file types. By streamlining data flows between payers and solutions, a world of opportunity exists to improve access to healthcare.

 

The Role:

At Flume Health, we’re leveraging AI to reimagine how healthcare data is mapped, validated, and integrated faster, more reliably, and at scale. We’re looking for a Software Engineer focused on AI workflows to help build and orchestrate pipelines that use foundation models like OpenAI’s or Google’s large language models (LLMs) to generate and iteratively refine data mappings.

You won’t be training models from scratch but you will be at the forefront of building robust workflows that interface with LLM APIs, run validation checks on outputs, and implement automated loops for refinement. If you enjoy piecing together modular AI processes, designing data-driven feedback loops, and working in a fast-paced, compliance-aware environment, this role is for you.

What You’ll Do:

  • Architect AI workflows that interpret user-provided specifications and generate data mappings using LLM APIs (e.g., OpenAI, Vertex AI), refining outputs based on validation feedback.

  • Implement intelligent retry and refinement loops to improve mapping accuracy using techniques like prompt chaining, structured validation, and contextual injection.
  • Develop prompt engineering strategies with support for domain-specific augmentation (e.g., via vector search or RAG).

  • Orchestrate pipelines with tools like Python and Airflow, integrating structured QA steps to monitor output quality and flag failures.

  • Collaborate across Data, Platform, and Product teams to embed these workflows into Flume’s core systems, ensuring performance, traceability, and compliance.

  • Stay up to date on the evolving LLM ecosystem understanding tradeoffs in cost, latency, and capability across vendors.

What You’ll Need:

  • 3+ years of software engineering experience, ideally in data, ML, or AI-driven product development.

  • Demonstrated experience building or orchestrating workflows that integrate with LLM APIs (e.g., OpenAI, Anthropic, Google).

  • Proficiency with Python and orchestration tools (e.g., Airflow, Dagster, Prefect).

  • Familiarity with prompt engineering concepts and iterative refinement techniques (e.g., looped retries, RAG, validation-based reruns).

  • Comfortable working in cloud-native environments (GCP or AWS) using Docker and Kubernetes.

  • Strong communication skills able to translate business needs into repeatable, explainable, and traceable AI workflows.

Technologies We Use:

  • LLM Tools & APIs: OpenAI, Vertex AI, DSPy, LangChain (where appropriate)

  • Workflow & Orchestration: Python, Airflow, custom feedback/retry frameworks

  • Cloud & Infra: GCP (BigQuery, Pub/Sub), Kubernetes, Docker, Terraform

  • Healthcare Standards: EDI, FHIR, HIPAA-compliant pipelines

  • Monitoring & Versioning: Logging/metrics pipelines, prompt version control

Nice to Haves:

  • Experience with vector databases or semantic search tools (e.g., Pinecone, Weaviate, Qdrant).

  • Exposure to regulated data environments, such as healthcare or finance.

  • Understanding of LLM orchestration frameworks (LangChain, DSPy, HuggingFace Accelerate).

  • Interest in evaluating the effectiveness of LLM outputs using custom metrics or domain-specific rules.

  • Contributions to open-source AI tooling or AI workflow libraries.

Special Note:

  • Candidates will be required to travel for in person team meetings once a quarter.

Salary Range:

  • $150K to $180K

Flume’s Perks & Benefits

  • Flexible PTO - you’re going to be working hard so enjoy time off
  • A robust stock option plan to give our employees a direct stake in Flume’s success
  • WFH stipend - we’ve always been remote first 
  • Competitive compensation and 401k with a 4% match
  • Comprehensive health coverage (medical, dental, vision) 

Average salary estimate

$165000 / YEARLY (est.)
min
max
$150000K
$180000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Software Engineer - AI Workflows, Flume Health

At Flume Health, we’re on a mission to reshape the healthcare data landscape, and we’re looking for a passionate Software Engineer - AI Workflows to join our innovative team in New York. If you’re excited about leveraging cutting-edge AI to streamline health plan administration, you’ll fit right in! In this role, you’ll work with foundation models like those from OpenAI and Google to build and enhance data mapping workflows that will transform how healthcare data is validated and integrated. You won’t be starting model training from scratch; instead, you'll craft robust workflows that connect to APIs, run validation checks, and implement smart feedback loops for continuous improvement. Collaboration is key, as you’ll work closely with various teams to seamlessly embed these workflows into our core systems, ensuring compliance and performance. With over three years of software engineering experience under your belt, preferably in data or AI-driven projects, and your proficiency in Python, Airflow, and cloud-native environments, you’re well-equipped to tackle the challenges we face. Ready to jump into a fast-paced environment where your contributions will make a tangible difference? Then Flume Health is ready for you! Join us as we unlock the potential of healthcare data together.

Frequently Asked Questions (FAQs) for Software Engineer - AI Workflows Role at Flume Health
What are the main responsibilities of a Software Engineer - AI Workflows at Flume Health?

As a Software Engineer - AI Workflows at Flume Health, your primary responsibilities will include architecting AI workflows to generate and refine data mappings using LLM APIs like OpenAI and Google. You will implement validation feedback loops, develop prompt engineering strategies, and orchestrate workflows with tools like Python and Airflow. Collaboration with other teams is essential to ensure these workflows integrate smoothly into our core systems, prioritizing performance and compliance on our journey to improve healthcare access.

Join Rise to see the full answer
What qualifications are needed for the Software Engineer - AI Workflows position at Flume Health?

To be considered for the Software Engineer - AI Workflows role at Flume Health, you need at least 3 years of software engineering experience, especially in data, ML, or AI product development areas. Proven experience with LLM APIs, proficiency in Python, and familiarity with orchestration tools like Airflow are also essential. Additionally, a strong understanding of cloud-native environments, as well as effective communication skills, will greatly benefit you in this position.

Join Rise to see the full answer
What technologies will I work with as a Software Engineer - AI Workflows at Flume Health?

As a Software Engineer - AI Workflows at Flume Health, you will engage with a variety of cutting-edge technologies. You'll utilize LLM tools and APIs such as OpenAI and Vertex AI, and work with Python and Airflow for workflow orchestration. Additionally, you'll leverage cloud infrastructure on platforms like GCP or AWS, using Docker and Kubernetes. Familiarity with healthcare standards like FHIR and HIPAA-compliant pipelines will be beneficial, as will exposure to monitoring and versioning technologies.

Join Rise to see the full answer
Are there travel requirements for the Software Engineer - AI Workflows position at Flume Health?

Yes, there is a travel requirement for the Software Engineer - AI Workflows role at Flume Health. Candidates will need to participate in in-person team meetings once a quarter. This is a great opportunity to connect with the team and foster collaboration, ensuring everyone is aligned on our goals.

Join Rise to see the full answer
What are the perks and benefits for a Software Engineer - AI Workflows at Flume Health?

Flume Health offers a variety of attractive perks and benefits for the Software Engineer - AI Workflows position, including flexible PTO, a robust stock option plan, and a WFH stipend, recognizing our remote-first culture. You’ll also enjoy competitive compensation, comprehensive health coverage (medical, dental, vision), and a 401k plan with a 4% match, all designed to support your well-being and financial health.

Join Rise to see the full answer
Common Interview Questions for Software Engineer - AI Workflows
Can you explain your experience with LLM APIs in your work as a Software Engineer?

In my previous roles, I've worked with various LLM APIs, specifically focusing on their integration into data workflows. I utilized tools like OpenAI’s API to generate data mappings and employed techniques like prompt chaining for refinement. My experiences taught me about trade-offs between cost and latency, which I handled by optimizing the workflow architecture to balance performance with budget.

Join Rise to see the full answer
How do you approach prompt engineering for AI models?

When approaching prompt engineering, I start by identifying the user’s specific requirements and then iteratively refine the prompts. I analyze output quality and use structured validation techniques to streamline the process. By maintaining flexibility in prompt design and integrating feedback loops, I ensure that AI outputs align with the precise needs of the project.

Join Rise to see the full answer
Describe a challenging project where you had to manage data integration workflows.

In a recent project, I led the integration of multiple data sources for a health application, which involved complex workflows. I developed a comprehensive pipeline using Airflow, which included automated validation checks and real-time error handling. By collaborating with cross-functional teams, I ensured smooth data integration, which improved data accessibility and stakeholders’ decision-making processes.

Join Rise to see the full answer
What tools have you used for orchestration in your past projects?

I have utilized Airflow extensively for orchestration, given its flexibility and ease of use for modeling complex workflows. I’ve also explored Dagster and Prefect for certain projects. These tools helped me create reliable scheduling of jobs and integrated quality checks to ensure output consistency.

Join Rise to see the full answer
How do you keep up with advancements in AI and ML technologies?

I regularly engage with various AI and ML communities through webinars, workshops, and online courses. I also follow industry news and contribute to open-source projects, which keeps my knowledge up-to-date and exposes me to cutting-edge tools and methodologies that I can apply in my work.

Join Rise to see the full answer
What cloud-native environments have you worked in?

I have significant experience working in both GCP and AWS cloud-native environments. Most recently, I utilized GCP infrastructure for deploying applications, leveraging services like BigQuery for data warehousing and Kubernetes for container orchestration. My experience extends to using Docker for developing and deploying microservices within these environments.

Join Rise to see the full answer
Can you give an example of how you handle feedback during an AI workflow process?

In an AI workflow, I implement structured validation checks that gather user and system feedback. Once feedback is received, I analyze the responses to make necessary adjustments to the prompts or workflow parameters. This iterative process not only enhances the quality of the outputs but also builds trust with stakeholders who see their input directly influencing the results.

Join Rise to see the full answer
How do you ensure compliance and data security in your workflows?

To ensure compliance in my workflows, I integrate tasks that adhere to healthcare regulations like HIPAA from the ground up. I create pipelines that include audits and validations, ensuring that all data handling processes meet compliance requirements. This also involves regular collaboration with compliance teams to stay updated on the latest regulations affecting workflow design.

Join Rise to see the full answer
What strategies do you use to improve the accuracy of AI outputs?

I implement several strategies to boost AI output accuracy, such as using iterative refinement techniques like re-running with adjusted prompts based on validation results. Additionally, I utilize feedback loops that allow the AI model to learn from its mistakes. Incorporating domain-specific rules also helps enhance the relevance and accuracy of the outputs.

Join Rise to see the full answer
Why are you interested in working for Flume Health as a Software Engineer - AI Workflows?

I’m excited about the opportunity to work at Flume Health because of its commitment to transforming healthcare through technology. I believe my background in AI and data integration aligns perfectly with your mission to enhance healthcare access. Contributing to streamlined health plan administration is a cause I am passionate about, and I’m eager to leverage my expertise to make a positive impact.

Join Rise to see the full answer
Similar Jobs
Photo of the Rise User
Posted 11 days ago

Become a pivotal part of The Farmer’s Dog as a Software Engineer 3, enhancing our innovative platform for pet health services.

Photo of the Rise User

Seeking a Senior Java Test Automation Engineer with extensive experience in Java development and a solid understanding of Agile methodologies.

Photo of the Rise User

Seeking an experienced Senior Python Django Developer to join our remote team and deliver high-quality web applications.

Photo of the Rise User
Google Hybrid Mountain View, California, United States
Posted 13 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Bias Training
Employee Resource Groups
401K Matching
Paternity Leave
Maternity Leave
Some Meals Provided
Social Gatherings

Join the Google Pixel team as a Software Engineer III, where you'll develop advanced technologies that enhance user experiences across mobile devices.

Photo of the Rise User
Posted 8 days ago
Customer-Centric
Rapid Growth
Diversity of Opinions
Reward & Recognition
Friends Outside of Work
Inclusive & Diverse
Empathetic
Feedback Forward
Work/Life Harmony
Casual Dress Code
Startup Mindset
Collaboration over Competition
Fast-Paced
Growth & Learning
Open Door Policy
Rise from Within
Maternity Leave
Paternity Leave
Flex-Friendly
Family Coverage (Insurance)
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Paid Holidays
Paid Sick Days
Paid Time-Off

We are looking for an experienced Senior Software Engineer to develop innovative software solutions in Sunnyvale, CA.

An exciting opportunity for a Full-Stack Developer in Beverly Hills to lead API development and automations in a growing tech company.

Join Mistral AI as a Technical Lead Software Engineer and influence the future of AI technology while leading a skilled team.

Join Northrop Grumman as a Principal Software Engineer to lead cutting-edge developments in the Payload and Ground Systems Division.

Photo of the Rise User
Inclusive & Diverse
Mission Driven
Social Impact Driven
Passion for Exploration
Dare to be Different
Diversity of Opinions
Reward & Recognition
Empathetic
Feedback Forward
Work/Life Harmony
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Rise from Within
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Learning & Development
Work Visa Sponsorship
Employee Resource Groups
401K Matching
Paid Time-Off
Maternity Leave
Social Gatherings
Company Retreats
Photo of the Rise User
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Transparent & Candid
Growth & Learning
Fast-Paced
Collaboration over Competition
Take Risks
Friends Outside of Work
Passion for Exploration
Customer-Centric
Reward & Recognition
Feedback Forward
Rapid Growth
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Paternity Leave
Fully Distributed
Flex-Friendly
Some Meals Provided
Snacks
Social Gatherings
Pet Friendly
Company Retreats
Dental Insurance
Life insurance
Health Savings Account (HSA)
Photo of the Rise User
Posted 8 months ago
Mission Driven
Collaboration over Competition
Inclusive & Diverse
Growth & Learning
Maternity Leave
Paternity Leave
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Paid Time-Off
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
HQ LOCATION
No info
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
April 15, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
16 people applied to NodeJs developer at BlackStone eIT
Photo of the Rise User
Someone from OH, Westerville just viewed Summer Internship - Public Health Data Science at Cotiviti
V
Someone from OH, Cincinnati just viewed Part-Time Executive/Personal Assistant at VirtuHire
Photo of the Rise User
Someone from OH, Chillicothe just viewed Area Manager at The Hemp Co by Curaleaf at Curaleaf
Photo of the Rise User
Someone from OH, Cincinnati just viewed VP, B2B/Integrated Marketing at TEGNA Inc.
Photo of the Rise User
Someone from OH, Cincinnati just viewed Director, Marketing and GTM Strategy at Aspen Dental
Photo of the Rise User
Someone from OH, Cincinnati just viewed Senior Vice President, JLLIPT Marketing at JLL
Photo of the Rise User
Someone from OH, Cincinnati just viewed Vice President of Marketing at Forum Health
Photo of the Rise User
Someone from OH, Cincinnati just viewed Vice President of Marketing at Beacon
Photo of the Rise User
Someone from OH, Cincinnati just viewed Director of Growth Marketing at Sundays for Dogs
P
Someone from OH, Cincinnati just viewed Vice President of Marketing at ProCaps Labs
Photo of the Rise User
Someone from OH, Cincinnati just viewed Vice President, Marketing at Inmagine
Photo of the Rise User
Someone from OH, Cincinnati just viewed VP of Marketing at IDIQ
Photo of the Rise User
Someone from OH, Cincinnati just viewed VP of Marketing at Vultron
Photo of the Rise User
Someone from OH, Cincinnati just viewed Marketing Manager (Remote - US) at Jobgether
F
Someone from OH, Cincinnati just viewed Head of Marketing at FoodHealth Company
Photo of the Rise User
Someone from OH, Cincinnati just viewed VP, Paid Marketing (Remote - US) at Jobgether
Photo of the Rise User
Someone from OH, Cincinnati just viewed Hospital Marketing at Datadog
Photo of the Rise User
Someone from OH, Cincinnati just viewed Vice President, Institutional Marketing at Tutor.com
Photo of the Rise User
Someone from OH, Cincinnati just viewed Director, Marketing Campaign Management at Humana
J
Someone from OH, Cleveland just viewed Sprinkler Service Technician IV at JCI