Hiring.Camp

Software Engineer, GPU Performance

Heygen

·

Sep 28, 2026

Location
Los Angeles, Palo Alto, San Francisco, Toronto, Singapore · Los Angeles, California, United States · Palo Alto, California, United States · San Francisco, California, United States · Toronto, Ontario, Canada
Department
Engineering
Source
Greenhouse

Description

About HeyGen

At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade, visual content has become the preferred method of information creation, consumption, and retention. But the ability to create such content, in particular videos, continues to be costly and challenging to scale. Our ambition is to build technology that equips more people with the power to reach, captivate, and inspire audiences.
Learn more at www.heygen.com.  Visit our Mission and Culture doc here. 

Position Summary

HeyGen is building AI applications including Avatar IV, Photo Avatar, Interactive Avatar, and Video Translation. We’re looking for a Software Engineer focused on GPU performance to make the systems behind these experiences faster and more efficient.

You will work across model execution and inference infrastructure, using profiling and measurement to improve latency, throughput, and GPU cost. This role is a fit for an engineer who enjoys understanding how software uses the hardware beneath it.

Key Responsibilities

  • Use NVIDIA Nsight Systems, Nsight Compute, and PyTorch Profiler to investigate GPU utilization, kernel execution, memory bandwidth, and CPU–GPU data movement.
  • Identify bottlenecks across model execution, preprocessing, and inference serving, then measure the impact of each optimization.
  • Improve performance through batching, scheduling, memory management, and better GPU utilization.
  • Develop or integrate high-performance GPU kernels when existing implementations limit performance.
  • Build benchmarks and automated checks that catch performance regressions across representative video workloads.
  • Collaborate with AI researchers and infrastructure engineers to bring optimizations into production.
  • Measure the effect of changes on latency, throughput, cost, and output quality.

Qualifications

  • Experience optimizing GPU-based AI workloads or high-performance computing systems.
  • Proficiency in Python and experience with PyTorch or a similar machine learning framework.
  • Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and data movement between CPU and GPU.
  • Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.
  • Ability to turn performance experiments into reliable production changes and communicate tradeoffs clearly.

Preferred Qualifications

  • Experience with CUDA, Triton, or C++ GPU programming.
  • Experience optimizing video, image, audio, diffusion, or Transformer models.
  • Familiarity with multi-GPU inference, GPU interconnects, quantization, or large-scale model serving.
  • Experience building performance benchmarks or regression testing infrastructure.
  • Prior experience in a fast-paced technology environment.

What HeyGen Offers

  • Competitive salary and benefits package.
  • Dynamic and inclusive work environment.
  • Opportunities for professional growth and advancement.
  • Collaborative culture that values innovation and creativity.
  • Access to the latest technologies and tools.

HeyGen is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Join us at HeyGen

Help us make AI video faster and more accessible. We’d love to hear from you.

Skills

PythonMachine LearningPyTorch

Similar Jobs

30

GPU Software Engineer

Intel·US·Hybrid

1mo ago

GPU Software Engineer

Intel·US·Hybrid

1mo ago

GPU Software Engineer

Intel·US

1mo ago

GPU Software Engineer

Intel·US

1mo ago

GPU Software Engineer

Leidos·US

1mo ago

Senior System Software Engineer - GPU

Nvidia·Taipei, Taiwan

3d ago

Senior System Software Engineer - GPU

Nvidia·Taipei, Taiwan

3d ago

Senior Software Engineer - GPU and SOC

Nvidia·Santa Clara, California

1w ago

Senior Software Engineer - GPU and SOC

Nvidia·Santa Clara, California

1w ago

Software Engineer, GPU Infrastructure

Cohere·Los Angeles, California +3·Remote

2w ago

Staff Software Engineer - GPU System Software, Onboard Execution

Zoox·Boston, Massachusetts +2·Hybrid

2w ago

GPU Software Engineer - Cork, Ireland

Qualcomm·Cork, Munster

2w ago

Software Engineer - GPU Reliability

SW5 Consulting

Senior System Software Engineer - GPU

Nvidia·Bengaluru, Karnataka +2

3w ago

Senior System Software Engineer - GPU

Nvidia·Bengaluru, Karnataka +2

3w ago

Senior Systems Software Engineer, GPU Compute

Nebius·Amsterdam, North Holland·Remote

Senior System Software Engineer, GPU Firmware

Nvidia·Bengaluru, Karnataka +1

3w ago

Senior System Software Engineer, GPU Firmware

Nvidia·Bengaluru, Karnataka +1

3w ago

Senior Staff/Principal Software Engineer - GPU System Software, Onboard Execution

Zoox·Boston, Massachusetts +2·Hybrid

4w ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·Santa Clara, California +1·Remote

1mo ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·New York City, New York +1·Remote

1mo ago

Senior Software Engineer - GPU

Nvidia·Santa Clara, California

1mo ago

Senior Software Engineer - GPU

Nvidia·Santa Clara, California

1mo ago

Scene Generation GPU Software Engineer

MBDA UK·Bristol, England +1·Hybrid

1mo ago

Senior System Software Engineer, GPU Server

Nvidia·Hillsboro, Oregon +1

1mo ago

Senior System Software Engineer, GPU Server

Nvidia·Hillsboro, Oregon +1

1mo ago

Radar Systems GPU Software engineer

Aptiv·US

1mo ago

Senior System Software Engineer - GPU Power Management

Nvidia·Bengaluru, Karnataka +1

1mo ago

Senior System Software Engineer - GPU SW

Nvidia·Santa Clara, California

1mo ago

Senior System Software Engineer - GPU Power and Performance Management

Nvidia·Santa Clara, California

1mo ago