Senior Performance Engineer - Deep Learning

Build and support Transformer Engine, the open-source library for accelerating the training of Large Language Models. Collaborate on systems research that improves Deep Learning model performance, such as training using extremely low precision, parallelism methods, etc. Implement, benchmark, and optimize new Deep Learning models such as LLMs straight out of groundbreaking research to scale efficiently on NVIDIA GPUs and systems. Build and contribute to NVIDIA submissions on community benchmarks such as MLPerf. Experience in PyTorch, JAX, or any other DL framework. Experience with performance analysis, profiling, and code optimization techniques, especially with multi-GPU or multi-node systems. Experience in writing GPU kernels using any of - CUDA, OpenAI Triton, CuTeDSL, Pallas, or other similar libraries.