Hiring.Camp

Software Engineer, Compute Infra

xAI

·

Mar 6, 2026

Salary
$180k – $440k
Location
Palo Alto, CA · Palo Alto, California, United States
Department
Infrastructure
Source
Greenhouse

Description

About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Role

The Compute Infrastructure team at xAI is responsible for designing, building, and operating the massive-scale clusters and orchestration platforms that power frontier AI training, inference, and agent workloads at unprecedented scale. In this role, you will push the boundaries of container orchestration far beyond existing systems like Kubernetes, manage exascale compute resources, optimize for high-performance training runs and production serving, and collaborate closely with research and systems teams to deliver reliable, ultra-scalable infrastructure that enables xAI's next-generation models and applications.

Responsibilities

  • Build and manage massive-scale clusters to host, persist, train, and serve AI workloads with extreme reliability and performance.
  • Design, develop, and extend an in-house container orchestration platform that achieves superior scalability, isolation, resource efficiency, and fault-tolerance compared to off-the-shelf solutions.
  • Collaborate with research teams to architect and optimize compute clusters specifically for large-scale training runs, inference services, and real-time applications.
  • Profile, debug, and resolve complex system-level performance bottlenecks, resource contention, scheduling issues, and reliability problems across the full stack.
  • Own end-to-end infrastructure initiatives with first-principles design, rigorous testing, automation, and continuous optimization to support frontier AI compute demands.

Required Qualifications

  • Deep expertise in virtualization technologies (KVM, Xen, QEMU) and advanced containerization/sandboxing (Kata, Firecracker, gVisor, Sysbox, or equivalent).
  • Strong proficiency in systems programming languages such as C/C++ and Rust.
  • Proven track record profiling, debugging, and optimizing complex system-level performance issues, with deep knowledge of Linux kernel internals, resource management, scheduling, memory management, and low-level engineering.
  • Hands-on experience building or significantly enhancing distributed compute platforms, orchestration systems, or high-performance infrastructure at scale.
  • Ability to thrive in a fast-paced, meritocratic environment with full ownership, high standards, and a focus on rigorous execution.

Preferred Qualifications

  • Experience in Linux kernel development, hypervisor extensions, or low-level system programming for compute-intensive workloads.
  • Proven track record operating or designing large-scale AI training/inference clusters (GPU/TPU scale).
  • Experience with custom runtimes, isolation techniques, or bespoke platforms for specialized AI compute.
  • Familiarity with performance tools, tracing, and debugging in production distributed environments.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Skills

RustKubernetesLinux

Similar Jobs

30

Software Engineer, Compute

Vercel·San Francisco, California·Hybrid

2w ago

Software Engineer - Compute

Lambda·Bellevue, Washington +2·Hybrid

3mo ago

Automation Engineer - Compute Software Performance

Zoox·Foster City, California·Hybrid

1w ago

Full Stack Software Engineer, Compute

Nominal·Austin, Texas +3·Onsite

1w ago

Senior Staff Software Engineer – Compute Engineering

ServiceNow·Santa Clara, California·Hybrid

3w ago

Senior Software Engineer – Compute Engineering

ServiceNow·Santa Clara, California·Hybrid

3w ago

Senior Software Engineer, Compute Service

Snowflake·Bellevue, Washington +1

3w ago

Software Engineer, Compute and Isolation

Baseten·New York City, New York +1·Hybrid

3w ago

Senior Software Engineer - Compute Control Plane - Remote

Akamai·Prague, Czechia·Remote

1mo ago

[Infra] Staff/Lead Software Engineer – Compute Platform (Bangkok Based, relocation provided)

Agoda·Bangkok, Thailand·Remote, Onsite

1mo ago

Software Engineer, Compute Operations

Fluidstack·New York City, New York·Onsite

1mo ago

Staff Software Engineer, Compute Platform

Fastly·Denver, Colorado +1·Remote

1mo ago

Staff Software Engineer, Compute and Network

Attentive·New York City, New York

1mo ago

Principal Software Engineer, Compute Architect, Orbital Data Centers

Blueorigin·Cupertino, California +7

1mo ago

Software Engineer, Compute Foundations

Openai·San Francisco, California

2mo ago

Senior Software Engineer, Compute Infrastructure

Databricks·Mountain View, California

Senior Software Engineer, Compute Software

Waymo·Bengaluru, Karnataka +1·Hybrid

Staff Software Engineer, Compute Platform (Routing)

Coinbase·US·Remote

Senior Software Engineer, Compute Platform Integration

Andurilindustries·Irvine, California

3mo ago

Principal Staff Software Engineer - Compute Infrastructure

LinkedIn·Mountain View, California·Hybrid

3mo ago

Staff Software Engineer - Compute

Lambda·Bellevue, Washington +2·Hybrid

3mo ago

Staff Software Engineer - Compute Infrastructure

LinkedIn·Mountain View, California·Hybrid

3mo ago

Senior Systems Software Engineer, Compute Stack Acceleration

Nvidia·New York City, New York +3·Remote

4mo ago

Senior Systems Software Engineer, Compute Stack Acceleration

Nvidia·Houston, Texas +3·Remote

4mo ago

Senior Software Engineer, Compute Cell Platform

Roblox·San Mateo, Calabarzon +1·Remote, Hybrid, Onsite

Software Engineer, Compute (GPU)

Fluidstack·Austin, Texas +3·Onsite

4mo ago

Software Engineer, Compute Infrastructure

Render·San Francisco, California·Remote

4mo ago

Staff Software Engineer, Compute Reliability

Waymo·Mountain View, California·Hybrid

Senior Software Engineer, Compute Architecture

Coreweave·Livingston, New Jersey +1

Software Engineer, Compute Infrastructure

Openai·London, England +3·Hybrid

6mo ago