Hiring.Camp

AI Infrastructure Engineer (Senior/Staff)

RFS Group

·

2 weeks ago

Salary
$130k – $300k
Workplace
Remote, Onsite
Type
Full-time
Department
Engineering
Seniority
Senior
Source
RecruiterFlow

Description

Member of Technical Staff, iOS

Location: San Francisco, CA
Company Stage of Funding: Series C AI Infrastructure Company ($10B Valuation)
Office Type: Onsite (5 Days Per Week)
Salary: $130,000–$300,000 + Equity

Company Description

We're representing one of the fastest-growing AI infrastructure companies building the connection between human expertise and frontier AI models. Their platform enables millions of experts to contribute to AI development while helping leading AI labs and Fortune 500 companies capture, evaluate, and operationalize human knowledge at scale.

About Us

We build the data and evaluation layer that frontier AI labs train on: expert marketplaces, licensed real-world work data, and RL environments. Compute is now a core product input. This hire joins a small, senior GPU platform team under the VP of Engineering and owns the clusters, schedulers, and serving stack that every model we train and run depends on. There is no finished platform to inherit; the engineer designs it, writes production code daily, and carries it through on-call.

What the role owns

  • GPU clusters across AWS, GCP, neoclouds and on-prem: custom Kubernetes and Slurm operators and the metadata services behind them.

  • Scheduling that keeps accelerators busy: gang scheduling, bin-packing, quotas and fair share for multi-tenant teams.

  • Distributed training infra (PyTorch Distributed, Ray, Megatron) with fast checkpointing; high-throughput LLM serving on vLLM (TP/EP, prefill/decode disaggregation, KV-cache offload, FP8/FP4).

  • Fleet health: hardware/network/software checks with automated remediation; DCGM, Prometheus, Grafana; utilization and billing ingestion for cost attribution and capacity planning.

Must-haves 

  • 5+ years building and operating production distributed systems or ML infra (7+ for Staff), counted from full-time industry roles only.

  • Has already run GPU workloads at real scale in production. Resume names the systems and the numbers: cluster or node counts, GPU generations, QPS, GPU-hours recovered. Zero handholding; this is not a learn-on-the-job role.

  • Owned at least one of: a GPU cluster or scheduler (Kubernetes + Slurm), distributed training infrastructure, or an LLM serving stack. Hands-on, not "partnered with the scheduling team."

  • Production Python plus Go or C++. Deep Kubernetes. Working Slurm or other HPC resource manager. One major cloud in depth. Comfortable on-call.

  • Individual contributor who still writes code. Directors, architects and managers who stopped shipping code several years ago are not a fit (we have a separate Head of Infrastructure search).

Process

Recruiter screen → initial technical screen with the VP of Engineering → onsite: infra coding (Python), algorithms, AI-specific system design, and a 45-minute GPU-specific interview. 

Compensation and Benefits

  • Base salary: $200,000–$400,000+
  • Generous equity package vested over four years.
  • Bi-annual performance bonus.
  • Up to $15,000 relocation assistance.
  • $10,000 housing bonus for employees living within 0.5 miles of the office.
  • $1,500 monthly meal stipend.
  • Complimentary Equinox membership.
  • $200 monthly laundry reimbursement.
  • $200 monthly wellness reimbursement.
  • Comprehensive medical, dental, and vision insurance.
  • Opportunity to build the native mobile experience for one of the world's fastest-growing AI companies while helping define the future of its mobile platform alongside world-class engineers, product leaders, and AI researchers.
 
 
 
 

Skills

PythonAWSGCPKubernetesPyTorchiOS

Similar Jobs

30

AI Infrastructure Engineer

Scout Motors·Charlotte, North Carolina·Hybrid

1d ago

AI Infrastructure Engineer

Professional Kyndryl·US·Remote

1w ago

AI Infrastructure Engineer

Delos Data·Cambridge, England·Hybrid

3w ago

AI Infrastructure Engineer

Mercor·San Francisco, California·Onsite

3w ago

AI Infrastructure Engineer

UbiOps·Den Haag

4w ago

AI Infrastructure Engineer

Immunai

AI Infrastructure Engineer

Playerzero·San Francisco, California·Hybrid

1mo ago

AI Infrastructure Engineer

AXQ Capital·Beijing, China

1mo ago

AI Infrastructure Engineer

vCluster Labs·New York City, New York·Remote

1mo ago

AI Infrastructure Engineer

vCluster Labs·Singapore·Remote

1mo ago

AI Infrastructure Engineer

Percepta·New York City, New York·Onsite

1mo ago

AI Infrastructure Engineer

Propio·Remote, Hybrid

AI Infrastructure Engineer

Netpreme·Santa Clara, California·Onsite

2mo ago

AI Infrastructure Engineer

Fortinet·New York, US·Hybrid

2mo ago

AI Infrastructure Engineer

Sciforium·San Francisco, California·Onsite

3mo ago

AI Infrastructure Engineer

42Dot·South Korea·Hybrid

4mo ago

AI Infrastructure Engineer

AMAX·Fremont, California

AI Infrastructure Engineer

Together·San Francisco, California

6mo ago

AI Infrastructure Engineer

Intercom·Berlin, State of Berlin +2

7mo ago

AI Infrastructure Engineer

Intercom·Berlin, State of Berlin +2

7mo ago

AI Infrastructure Engineer

vCluster Labs·New York City, New York·Remote

7mo ago

AI Infrastructure Engineer

Meshy LLC·Beijing, China·Hybrid

8mo ago

AI Infrastructure Engineer

Spellbrush·San Francisco, California·Remote, Onsite

1y+ ago

AI Infrastructure Engineer

Spellbrush·San Francisco, California +1·Remote, Onsite

MLOps / DevOps Engineer – AI Infrastructure

Creatoriq·Los Angeles, California +3

1d ago

Principal Agentic AI Infrastructure Engineer

Circana·India

2d ago

Sr. Infrastructure Engineer, AI Platforms & Enablement

Markelcorp·Richmond VA - 4501 Highwoods, US

2d ago

AI Infrastructure Engineer Intern, MS - Summer 2027

Marvell·Canada

4d ago

Senior Data Engineer - AI Infrastructure Integration, High Performance Compute

Gh R·Charlotte, North Carolina +2·Hybrid

1w ago

Senior Data Engineer - AI Infrastructure Integration, High Performance Compute

Gh R·Charlotte, North Carolina +2·Hybrid

1w ago