Hiring.Camp

Senior ML Performance Engineer

Amadeus Search

·
Location
San Francisco, CA, Toronto, ON, Hybrid
Workplace
Remote, Hybrid
Type
Full-time
Department
Engineering
Seniority
Senior
Source
RecruiterFlow

Description

 Position: Senior ML Performance Engineer
Location: SF Bay Area (US) or Toronto (Canada) – Hybrid
Employment Type: Full-Time
Industry: AI Infrastructure / Compiler Systems

Overview

A venture-backed AI infrastructure company is building a high-performance, portable compiler designed to let developers “build once, deploy anywhere.” This includes cloud, edge, and hybrid environments — all optimized for resource efficiency, scalability, and sustainable AI development.

The team is looking for a Senior ML Performance Engineer to architect and lead a Performance Testing Platform from the ground up, measuring and optimizing the performance of large language models (LLMs) before and after compiler optimization on modern GPU architectures.

This role sits at the intersection of ML systems, GPU architecture, and performance engineering, with high visibility into product quality and customer impact.


Key Responsibilities

  • Design and implement a comprehensive performance testing platform for LLM inference workloads across GPU clusters

  • Define benchmarking methodologies, metrics, and test suites (latency, throughput, memory utilization, power consumption, and model accuracy)

  • Establish baseline performance for unoptimized models and validate post-optimization improvements

  • Build automated pipelines for continuous performance validation across compiler releases and model updates

  • Investigate performance bottlenecks using GPU profilers and system-level monitoring

  • Collaborate with compiler engineers, ML engineers, and DevOps to integrate performance testing into development workflows

  • Create dashboards and reporting to track performance trends, regressions, and wins

  • Document best practices for GPU-based ML performance testing


Required Qualifications

  • 7+ years in performance engineering, benchmarking, or systems engineering roles

  • Strong knowledge of ML inference workloads, particularly transformer-based LLMs

  • Hands-on GPU programming and optimization experience (CUDA, ROCm, or similar)

  • Strong programming skills in Python and C/C++

  • Proven experience building performance testing infrastructure or benchmarking platforms from scratch

  • Experience with ML frameworks: PyTorch, TensorFlow, ONNX Runtime, vLLM, TensorRT-LLM

  • Proficiency with profiling and debugging GPU workloads

  • Experience with CI/CD systems and test automation frameworks

  • Strong analytical skills with the ability to design experiments, analyze results, and communicate findings clearly


Nice to Have

  • AMD GPU experience (Mi200/Mi300) and ROCm ecosystem

  • Compiler optimization knowledge

  • Distributed inference and multi-GPU workloads

  • ML model quantization, pruning, and optimization techniques

  • High-performance computing or systems-level optimization

  • Infrastructure-as-code experience: Kubernetes, Docker, Terraform

  • Contributions to open-source ML or systems projects


Personal Attributes

  • Detail-oriented — able to spot subtle regressions

  • Self-driven and accountable

  • Collaborative and team-oriented

  • Passionate about sustainable AI

  • Clear and effective communicator


Compensation & Benefits

  • Competitive salary, dependent on experience and location

  • Equity and bonus opportunities

  • Medical, dental, and vision coverage

  • Retirement savings plan

  • Additional wellness benefits


Why This Role Is Unique

  • Build the infrastructure that validates high-performance ML models

  • Influence core product quality and customer outcomes

  • Work in a highly technical, high-impact environment at the forefront of AI systems

  • Collaborate across a globally distributed team

Skills

PythonDockerKubernetesTerraformCI/CDTensorFlowPyTorchDevOps

Benefits

Competitive salary, dependent on experience and locationEquity and bonus opportunitiesMedical, dental, and vision coverageRetirement savings planAdditional wellness benefits

Similar Jobs

6

Senior Software Engineer Ml Performance Genai Deepmind

Accounts·Remote

Senior Staff Machine Learning Performance Engineer

Xpengmotors·Mountain View, California +1

3w ago

Lead Engineer, Senior-System Performance Engineer (NSP, AI/ML, CPU, DDR)

Qualcomm·Bengaluru, Karnataka

3w ago

Senior/Staff Software Engineer, ML Training Performance

Zoox·Foster City, California +1·Onsite

1mo ago

Senior Software Engineer Ml Compiler Frameworks And Performance

Google

Senior AI/ML Capacity and Performance Engineer

General Motors·Washington, US·Remote

7mo ago