Hiring.Camp

Senior Software Test Development Engineer - AI Infra, SDET

Nvidia

·

2 days ago

Location
Shanghai, Shanghai,CN, CN
Type
Full-time
Department
Engineering
Seniority
Senior
Experience
5+ years
Source
Eightfold

Description

We are looking for a Senior Software Development Engineer in Test to join NVIDIA’s AI Software Quality Assurance team, focusing on AI software and GPU infrastructure across model training, post-training, and inference.

You will develop automated tests and test infrastructure to validate the functionality, performance, scalability, and reliability of distributed AI systems. Working closely with global engineering teams, you will contribute to evolving AI frameworks, serving platforms, and reinforcement learning workflows across diverse GPU computing environments. You will also apply AI tools and agents to improve test development, failure analysis, and release qualification.

What you’ll be doing:

  • Collaborate with global cross-functional teams to understand product requirements, identify quality risks, and own test strategy and coverage for assigned areas.
  • Design, develop, execute, and automate functional, integration, regression, performance, and reliability tests for AI frameworks, distributed execution platforms, and end-to-end AI workloads.
  • Validate distributed AI workloads across multi-GPU and multi-node environments, including deployment, resource management, scaling, and failure recovery.
  • Develop and maintain Python-based test frameworks and CI/CD pipelines for reproducible testing across containerized and GPU cluster environments.
  • Reproduce customer issues, isolate failures across software and infrastructure components, drive bug resolution, and verify fixes.
  • Build AI-assisted QA workflows for test generation, execution, log analysis, failure triage, and reporting, with measurable improvements in efficiency and result quality.

What we need to see:

  • Master’s degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
  • 5+ years of experience in software test development, test automation, or systems software engineering, with strong analytical and debugging skills.
  • Strong Python programming skills and experience developing maintainable automated tests and test frameworks using tools such as pytest.
  • Hands-on Linux administration and troubleshooting experience, including processes, networking, memory, storage, and container runtime issues.
  • Practical experience with Docker and at least one cluster orchestration or scheduling platform, such as Kubernetes or Slurm.
  • Experience developing CI/CD automation and diagnosing failures using logs, metrics, and test artifacts.
  • Demonstrated use of AI coding tools or agents to improve engineering productivity, with the ability to independently validate generated code and conclusions.
  • Excellent English written and verbal communication skills, with the ability to collaborate across teams and drive issues to resolution.

Ways to stand out from the crowd:

  • Experience with AI frameworks and platforms such as PyTorch, vLLM, SGLang, NVIDIA TRT-LLM, NVIDIA Dynamo, or Verl.
  • Hands-on development, integration, or testing experience in at least one of the following areas: distributed model training, LLM inference and serving, or reinforcement learning post-training.
  • Experience with Rust for systems programming, particularly asynchronous programming and concurrency, with the ability to read source code, diagnose issues, and develop targeted tests for performance-critical components.
  • Understanding of distributed AI concepts such as model parallelism, inference scheduling, KV-cache management, or reinforcement learning rollout and training workflows. Familiarity with Kubernetes Operators, CRDs, Helm, and observability tools such as Prometheus, Grafana, and OpenTelemetry.
  • Familiarity with NVIDIA GPU platforms and high-performance communication technologies such as NVLink, InfiniBand/RoCE, RDMA, NCCL, or NIXL.

Skills

PythonRustDockerKubernetesCI/CDLinuxPyTorchLLM

Similar Jobs

30

Senior Software Development Engineer in Test

Akamai·US·Remote

1d ago

Senior Software Engineer in Test

Jobs at the Leader in Identity and Access Management | Okta·Toronto, Ontario

Senior Software Engineer in Test

Jobs at the Leader in Identity and Access Management | Okta·Toronto, Ontario

Senior Software Engineer in Test

Jobs at the Leader in Identity and Access Management | Okta·Toronto, Ontario

Senior Software Development Engineer in Test - Okta Identity Governance

Jobs at the Leader in Identity and Access Management | Okta·Toronto, Ontario·Hybrid

Senior Associate, Software Engineering: Software Development Test (SDET)

theocc·Chicago, Illinois·Hybrid

1d ago

Senior Software Development Engineer Test I

Jiostar·India·Onsite

1d ago

Senior Software Development Engineer in Test (SDET)

Workatbackbase·Kraków, Lesser Poland

1d ago

Senior Software Engineer, Test

Veeam Software·Mumbai, Maharashtra·Hybrid

2d ago

Senior Software Development Engineer in Test

Mdtkangaroo·US·Onsite

2d ago

Upcoming Opportunity - Senior Staff Software Engineer - Test (SDET) - Paze

earlywarningservices·Chicago, Illinois +2·Hybrid

2d ago

Senior Software Test Engineer

Mpathic2

2d ago

Sr. Associate II, Software Engineering (Senior Test Engineer)

Alcon·Mumbai, Maharashtra

2d ago

Senior Software Test Development Engineer - AI Infra, SDET

Nvidia·Shanghai, China

2d ago

Senior Software Development Engineer in Test

Trellix·Mumbai, Maharashtra·Hybrid

2d ago

Senior Software Engineer - Test

Esyasoft·Mumbai, Maharashtra

2d ago

Sr. Software Development Engineer in Test I

Ajaib·Jakarta, Indonesia·Hybrid

2d ago

Sr Software Test Engineer

Synchronoss·Bengaluru, Karnataka

2d ago

Senior Software Development Engineer in Test - Okta Identity Governance

Okta·Toronto, Ontario·Hybrid

Senior Software Development Engineer in Test

SailPoint is·UK·Remote

3d ago

Senior Software Test Engineer - ETCS RBC Operation & Maintenance Server

HiNext·Romania·Hybrid

3d ago

Senior Software Development Engineer in Test, Data & AI Platforms

Motorola Solutions·Brazil Offsite·Remote

3d ago

Senior Software Development Engineer in Test, Data & AI Platforms

Motorola Solutions·Brazil Offsite·Remote

3d ago

Senior Software Test Development Engineer

Nvidia·Pune, Maharashtra

3d ago

Senior Software Test Development Engineer

Nvidia·Pune, Maharashtra

3d ago

Senior Software Engineer in Test I

Emburse·Toronto, Ontario·Onsite

3d ago

Développeur ou développeuse principal(e) de tests logiciels, réseaux sans fil (LTE/5G) / Senior Software Test Developer, Wireless Networks (LTE/5G)

Syntronic·Montréal, Quebec·Onsite

3d ago

Senior Software Test Engineer

XLA·College, Alaska +1·Onsite

3d ago

Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai·Poland·Remote

3d ago

Senior Software Development Engineer in Test

Nvidia·Santa Clara, California

4d ago