Job details

AI Infra Engineer

Perplexity, a leading AI-powered answer engine with over $1B in venture funding, is seeking an AI Infrastructure Engineer to join their team. The role involves building and optimizing large-scale AI training and inference clusters using Kubernetes, Slurm, Python, and AWS, working collaboratively with Infrastructure and Research teams.

Skills

Expert-level Kubernetes administration and YAML configuration
Proficiency with Slurm job scheduling and cluster configuration
Python and C++ programming focused on systems and infrastructure automation
Hands-on experience with ML frameworks such as PyTorch in distributed training
Strong understanding of networking, storage, and compute resource management
Experience developing APIs and managing distributed batch and real-time workloads
Solid debugging and monitoring skills with observability tools for containerized environments

Responsibilities

Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads
Manage and optimize Slurm-based HPC environments for distributed training of large language models
Develop robust APIs and orchestration systems for training pipelines and inference services
Implement resource scheduling and job management systems across heterogeneous compute environments
Benchmark system performance, diagnose bottlenecks, and implement improvements
Build monitoring, alerting, and observability solutions tailored to ML workloads
Respond swiftly to system outages and collaborate across teams to maintain high uptime
Optimize cluster utilization and implement autoscaling strategies for dynamic workloads

Benefits

Comprehensive health, dental, and vision insurance for employees and dependents
401(k) retirement plan
Equity compensation in addition to base salary

To read the complete job description, please click on the ‘Apply’ button

AI Infrastructure Kubernetes Slurm Python C++ PyTorch AWS Distributed Training GPU Clusters ML Workloads SRE DevOps Cluster Management HPC Observability

Perplexity AI Glassdoor Company Review

3.1

Perplexity AI DE&I Review

2.6

CEO of Perplexity AI

Aravind Srinivas

Approve of CEO

Average salary estimate

$220000 / YEARLY (est.)

min

max

$190000K

$250000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Perplexity AI

Perplexity offers an AI chatbot-powered research and conversational search engine that answers queries using natural language predictive text. Since it's launch in 2022, has raised $165 million in funding, valuing the company at over $1 billion.

22 jobs

MATCH

Calculating your matching score...

BADGES