Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior Software Engineer, AI Flow Core Inference image - Rise Careers
Job details

Senior Software Engineer, AI Flow Core Inference

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 3 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
  • 3 years of experience with design and architecture; and testing/launching software products.
  • 3 years of experience with Gen AI algorithms and tools, LLMs or other multi-modal foundation models, natural language processing or inference performance optimization.

About the job:

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

In this role, you will be building the platform to integrate GenAI-based technologies into Google's suite of consumer-facing products. Your mission is to empower developers and researchers with GenAI enablement tools, driving innovation and unlocking the potential of Machine Learning (ML) across applications. You will play a pivotal role in building a team to ensure the deployment of genAI across Google is as easy, economical, and as fast as possible.The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities:

  • Leverage products built by the rest of Google, build a high-performing GenAI platform for first-party developers to apply ML into emerging and existing consumer products.
  • Collaborate with other stakeholders (e.g., CoreML, Google Deepmind, Google Labs, Search, Vertex, etc) to ensure we deliver highly available, performant, and secure APIs that scale globally.
  • Design, develop, and maintain the infrastructure behind Google's first-party GenAI platform, ensuring scalability, reliability, and performance.
  • Build and enhance API features with generations of Gemini, Imagen, Veo, and other LLMs.
  • Collaborate with cross-functional teams to deliver high-quality, production-grade solutions.
Google Glassdoor Company Review
4.4 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
Google DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of Google
Google CEO photo
Sundar Pichai
Approve of CEO

Average salary estimate

$205000 / YEARLY (est.)
min
max
$166000K
$244000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Google Hybrid San Bruno, California, United States
Posted 8 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Bias Training
Employee Resource Groups
401K Matching
Paternity Leave
Maternity Leave
Some Meals Provided
Social Gatherings

Seeking a Senior Music Data Scientist to lead causal studies and provide actionable insights for YouTube's Music business within the Business Go-To-Market team.

Photo of the Rise User
Google Hybrid Chicago, Illinois, United States
Posted 8 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Bias Training
Employee Resource Groups
401K Matching
Paternity Leave
Maternity Leave
Some Meals Provided
Social Gatherings

Serve as a Finance Analyst in Google's Trust and Safety team, delivering strategic financial insights to guide key business decisions.

Photo of the Rise User
Trinetix Hybrid No location specified
Posted 13 days ago

Seeking a proficient Flutter/Xamarin Developer to create and enhance high-quality mobile applications within a dynamic global tech company.

Photo of the Rise User

Experienced Senior Backend Software Engineer needed at Gabb to develop scalable backend systems that support millions of users in a mission-driven tech company.

GeoDelphi Hybrid No location specified
Posted 4 days ago

An exciting opportunity to join GeoDelphi as a Front-End Engineer crafting performant, user-centric React applications enriched with AI integration.

Photo of the Rise User
Get Air Management Hybrid Ogden, Utah, United States
Posted 12 days ago

A fast-growing trampoline park company in Ogden seeks a Full Stack Developer to create and enhance innovative web applications using PHP, JavaScript, and MySQL.

Photo of the Rise User
Posted 7 days ago

Contribute as a Full-Stack Software Engineer at Anduril Industries to develop advanced autonomy software platforms for aerial defense robotics.

Photo of the Rise User
Applied Intuition Hybrid Mountain View, California, United States
Posted 8 days ago

Senior Android Software Engineer position at Applied Intuition to develop innovative apps powering next-generation vehicle intelligence in a collaborative, fast-paced environment.

Photo of the Rise User
Roblox Hybrid San Mateo, California, United States
Posted 4 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Feedback Forward
Growth & Learning
Fast-Paced
Collaboration over Competition
Transparent & Candid
Casual Dress Code
Empathetic
Medical Insurance
Paid Time-Off
Maternity Leave
Donation Matching
Vision Insurance
Summer Fridays
401K Matching
Work Visa Sponsorship
Paid Volunteer Time
Equity
Mental Health Resources
Family Medical Leave

Lead the engineering of Roblox's next-generation wallet system to power seamless currency transactions within a global digital marketplace.

Photo of the Rise User

Lead the development and enhancement of enterprise IAM solutions for FICO’s platform, focusing on modern authentication technologies and security standards in a remote work setting.

Photo of the Rise User
CannonDesign Hybrid United States - Remote
Posted 8 days ago

Experienced Senior Software Engineer needed to lead architecture and development of scalable digital applications at CannonDesign.

Photo of the Rise User
Posted 12 days ago
Inclusive & Diverse
Growth & Learning
Customer-Centric
Collaboration over Competition
Medical Insurance
Maternity Leave
Flex-Friendly
401K Matching

Vanta is looking for an experienced Senior Fullstack Software Engineer to lead impactful projects and scale their product platform in a high-growth, security-focused company.

Photo of the Rise User
Posted 13 days ago

Drive technical excellence and innovation as a Staff Full Stack Engineer at LILT, developing cutting-edge machine translation platforms for global customers.

Photo of the Rise User
AtoB Hybrid No location specified
Posted 7 days ago

Drive scalable payment solutions and ledger infrastructure at AtoB, a trailblazer in modernizing payments for transportation.

Photo of the Rise User
Adonis Market Hybrid New York, New York, United States
Posted 7 days ago

Software Engineer needed to lead healthcare system integrations at Adonis, a cutting-edge AI orchestration startup based in New York City.

Organize the world’s information and make it universally accessible and useful.

824 jobs
MATCH
Calculating your matching score...
BADGES
Badge Diversity ChampionBadge Future MakerBadge Global CitizenBadge InnovatorBadge Rapid Growth
CULTURE VALUES
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Take Risks
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Friends Outside of Work
BENEFITS & PERKS
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Bias Training
Employee Resource Groups
401K Matching
Paternity Leave
Maternity Leave
Some Meals Provided
Social Gatherings
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
June 6, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!