Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy
Jobs / Job page
Senior software engineer (LLMs and Agentic Systems) image - Rise Careers
Job details

Senior software engineer (LLMs and Agentic Systems)

Nebius is leading a new era in cloud computing to serve the global AI economy. We are seeking a highly skilled and experienced Senior Software Engineer with a Machine Learning background to join our dynamic R&D team focused on large language models and agentic systems.

Skills

  • Strong software engineering skills in Python
  • Proficiency in CI/CD, version control and unit testing
  • Commitment to maintaining rigor, ownership and proactivity

Responsibilities

  • Designing and developing infrastructure that powers our research
  • Maximizing system performance, including optimizing LLM inference
  • Building web services to showcase and operationalize our research
  • Owning a part of the system

Benefits

  • Competitive salary and comprehensive benefits package
  • Opportunities for professional growth within Nebius
  • Hybrid working arrangements
  • Dynamic and collaborative work environment
To read the complete job description, please click on the ‘Apply’ button

Average salary estimate

$135000 / YEARLY (est.)
min
max
$120000K
$150000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Senior software engineer (LLMs and Agentic Systems), Nebius

Are you ready to take your career to the next level as a Senior Software Engineer with a focus on Large Language Models (LLMs) and Agentic Systems at Nebius? At Nebius, we’re reshaping the landscape of cloud computing for the global AI economy. We provide innovative tools and resources that empower our customers to address real-world challenges without the burden of massive infrastructure costs or the requirement of large in-house AI/ML teams. Based in Amsterdam and publicly listed on Nasdaq, Nebius boasts a talented team of over 800 professionals, including 400 skilled engineers and an in-house AI R&D team. As part of our dynamic AI R&D unit, you will be at the forefront of exciting projects exploring advanced themes such as enhancing agents with test-time guided search and scaling task data collection for reinforcement learning. In this role, you’ll be responsible for designing and developing the infrastructure that fuels our research, optimizing LLM performance, and building web services to showcase our innovations. Your extensive experience in software development and machine learning will not only contribute to the efficiency of processes but also play a crucial role in advancing our cutting-edge technologies. Our environment supports your growth and creativity, and we look forward to seeing how you’ll thrive with us at Nebius. If the future of AI and ML excites you as much as it does us, we want to hear from you!

Frequently Asked Questions (FAQs) for Senior software engineer (LLMs and Agentic Systems) Role at Nebius
What are the main responsibilities of the Senior Software Engineer at Nebius?

As a Senior Software Engineer at Nebius, your responsibilities will include designing and developing crucial infrastructure for research, optimizing LLM inference, managing data processing pipelines, and developing web services to operationalize our findings. You will also be expected to take ownership of various system components, thereby ensuring high performance and reliability across numerous parallel agent runs.

Join Rise to see the full answer
What qualifications are required for the Senior Software Engineer position at Nebius?

Candidates for the Senior Software Engineer position at Nebius should have a minimum of 5 years of professional software development experience, particularly in machine learning projects. Strong proficiency in Python and knowledge of contemporary software engineering practices, including CI/CD, version control, and unit testing, are essential. Applicants who can demonstrate hands-on experience with LLMs, agentic systems, and ML libraries will be at an advantage.

Join Rise to see the full answer
What programming languages should a Senior Software Engineer at Nebius be familiar with?

At Nebius, the primary programming language utilized is Python, however, familiarity with additional languages like Go, C++, and Rust is preferred. This diverse skill set can enhance collaboration within our multifaceted team and contribute to the development of robust machine learning infrastructure.

Join Rise to see the full answer
What opportunities for professional growth does Nebius offer to Senior Software Engineers?

Nebius is committed to the professional growth of all its employees. As a Senior Software Engineer, you will have numerous opportunities to expand your skill set through challenging projects, collaborative teamwork, and access to innovative tools. Our dynamic work environment encourages initiative and innovation, allowing for continuous learning and personal development.

Join Rise to see the full answer
What is the company culture like at Nebius for Senior Software Engineers?

The company culture at Nebius is collaborative, dynamic, and innovation-driven. Senior Software Engineers are encouraged to take ownership of their projects while working closely with talented colleagues across the organization. We value initiative and promote a flexible work environment that supports both personal and professional growth.

Join Rise to see the full answer
Common Interview Questions for Senior software engineer (LLMs and Agentic Systems)
Can you describe your experience with LLMs and agentic systems?

In your response, showcase specific projects you have worked on, emphasizing the role you played in utilizing LLMs and developing agentic systems. Discuss challenges you faced, the solutions you implemented, and the impact of your contributions on the project outcomes.

Join Rise to see the full answer
How do you approach optimizing performance in large-scale machine learning systems?

Discuss your methodologies for identifying bottlenecks in performance, such as profiling tools you’ve used. Share examples of past optimizations you've made, including details on technologies and frameworks that were utilized, showcasing your analytical process.

Join Rise to see the full answer
What role do CI/CD practices play in your software development process?

Elaborate on how you’ve implemented CI/CD in previous projects, focusing on the benefits it provided, such as improving deployment cycles and maintaining high code quality. Include specific tools you’ve used and how they fit into your overall workflow.

Join Rise to see the full answer
Describe a significant challenge you faced in software development and how you overcame it.

Choose a relevant example that demonstrates your problem-solving skills. Outline the context, the challenge, the steps you took to address it, and the final outcome, highlighting lessons learned that you can apply in your role at Nebius.

Join Rise to see the full answer
How familiar are you with data processing technologies like Spark or Hadoop?

Share your level of experience with these technologies, along with specific use cases. Offer insights on how you have used them in past projects related to machine learning and data processing, emphasizing your ability to analyze and manipulate large data sets.

Join Rise to see the full answer
What is your experience with Kubernetes or other container orchestration tools?

Discuss any relevant experience working with Kubernetes, focusing on deployment strategies, scaling applications, and managing containerized workflows. Explain how this experience can contribute to Nebius's infrastructure and overall project success.

Join Rise to see the full answer
Explain how you ensure code quality in your software development projects.

Detail your approach to code quality, which may include code reviews, testing strategies, and use of automated tools. Providing examples of how this practice has benefited past projects can help underline your commitment to high standards.

Join Rise to see the full answer
How do you stay updated on the latest trends and technologies in AI and ML?

Share your strategies for continuous learning, such as following industry leaders, attending relevant workshops, or participating in online courses. Mention any recent trends in AI and ML that you find particularly exciting and how they inform your work.

Join Rise to see the full answer
Can you give an example of a time when you worked effectively in a team on a technology project?

Pick an example illustrating your teamwork skills, highlighting your ability to collaborate, communicate, and align with team members' diverse skills to achieve project goals. Make sure to mention your role in fostering a positive team dynamic and ensuring project success.

Join Rise to see the full answer
What motivates you about working in AI and cloud computing?

Reflect on your passion for the field, discussing how it fuels your curiosity and drives your desire to innovate. Illustrate your vision for using AI and cloud technologies to solve real-world problems, aligning with Nebius's mission to reshape the global AI economy.

Join Rise to see the full answer
Similar Jobs
Nebius Remote Berlin, Germany · Remote - Europe
Posted 8 days ago
Nebius Remote New Jersey, United States
Posted 6 days ago
Photo of the Rise User
Lean TECHniques Remote No location specified
Posted 4 days ago
TMS LLC Remote Florida City, FL, USA
Posted 3 days ago
Photo of the Rise User
Posted 13 days ago
Photo of the Rise User
Opus 2 Remote No location specified
Posted 6 days ago
Photo of the Rise User
Posted 4 days ago
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
No info
HQ LOCATION
No info
SALARY RANGE
$120,000/yr - $150,000/yr
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
March 21, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!