Software Engineer - AI & LLM

Matillion is The Data Productivity Cloud.

We are on a mission to power the data productivity of our customers and the world, by helping teams get data business ready, faster. Our technology allows customers to load, transform, sync and orchestrate their data. 

We are looking for passionate, high-integrity individuals to help us scale up our growing business. Together, we can make a dent in the universe bigger than ourselves.

With offices in the UK, US and Spain, we are now thrilled to announce the opening of our new office in Hyderabad, India. This marks an exciting milestone in our global expansion, and we are now looking for talented professionals to join us as part of our founding team.

About the Role

At Matillion, we’re transforming the way data teams work by enabling them to extract valuable insights faster and more efficiently. As a Software Engineer, you'll be an integral part of a small, cross-functional development team, focused on building, testing, and releasing impactful features across our products. Your contributions will not only improve the core platform but also shape the future of how generative AI is leveraged within the data ecosystem.

You’ll bring hands-on expertise in Java and modern backend development, while also working with cutting-edge Generative AI technologies such as LLM APIs, RAG pipelines, and prompt engineering.

• Collaborate with your team to build production-grade services and applications using modern tech stacks.
• Own your workflow: writing high-quality, maintainable code, testing it, deploying it to production, and supporting it post-release.
• Participate in regular code reviews, knowledge-sharing sessions, and innovation initiatives focused on new technologies including GenAI.
• Contribute to internal research projects around LLMs, prompt optimization, and AI-enhanced product features.
• Continually develop your skills—both technical and interpersonal—through mentoring, self-learning, and team collaboration.
• Understand the domain and architecture of the system to help manage risk and guide improvements in processes and decision-making.

• Essential Skills & Experience
• Strong programming skills in Java with solid knowledge of OOP, design principles, and coding best practices.
• Experience building microservices using Spring and deploying them via container technologies (e.g., Docker).
• Comfortable working with relational databases and capable of writing efficient SQL.
• Experience in the full SDLC including CI/CD tooling and working in an Agile environment.
• Familiarity with cloud-native development, especially on AWS.
• Strong collaboration skills with the ability to adapt across a variety of technical challenges.

• Generative AI / LLM Expertise (Essential)
• Experience working with LLM APIs (e.g., OpenAI, Anthropic, HuggingFace).
• Skilled in prompt engineering to tune prompts and maximize LLM output quality.
• Understanding and implementation of Retrieval-Augmented Generation (RAG) workflows.
• Working knowledge of LLM concepts like system/user prompts, tokens, embeddings, context windows, temperature, top-p, and stop sequences.

• Nice to Have
• Experience with fine-tuning language models or training smaller models.
• Familiarity with prompt compression techniques to optimize context length.
• Exposure to GenAI architectures such as prompt chaining, routing, agentic design, etc.
• Experience using Spring AI or similar libraries that abstract LLM integrations.
• Familiarity with evals frameworks to benchmark and assess LLM performance.

Matillion has fostered a culture that is collaborative, fast-paced, ambitious, and transparent, and an environment where people genuinely care about their colleagues and communities. 

Our 6 core values guide how we work together and with our customers and partners. We operate a truly flexible and hybrid working culture that promotes work-life balance, and are proud to be able to offer the following benefits:

- Company Equity

- 27 days paid time off

- 12 days of Company Holiday

- 5 days paid volunteering leave

- Group Mediclaim (GMC)

- Enhanced parental leave policies

- MacBook Pro

- Access to various tools to aid your career development

More about Matillion

Thousands of enterprises including Cisco, DocuSign, Slack, and TUI trust Matillion technology to load, transform, sync, and orchestrate their data for a wide range of use cases from insights and operational analytics, to data science, machine learning, and AI. 

With over $300M raised from top Silicon Valley investors, we are on a mission to power the data productivity of our customers and the world.

We are passionate about doing things in a smart, considerate way. We’re honoured to be named a great place to work for several years running by multiple industry research firms. 

We are dual headquartered in Manchester, UK and Denver, Colorado.

We are keen to hear from prospective Matillioners, so even if you don’t feel you match all the criteria please apply and a member of our Talent Acquisition team will be in touch. Alternatively, if you are interested in Matillion but don't see a suitable role, please email talent@matillion.com.

Matillion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all of our team. Matillion prohibits discrimination and harassment of any type. Matillion does not discriminate on the basis of race, colour, religion, age, sex, national origin, disability status, genetics, sexual orientation, gender identity or expression, or any other characteristic protected by law.