Hiring.Camp

Software Engineer, LLM Inference

Nvidia

·

Today

Location
China, Beijing
Type
Full-time
Department
Engineering
Education
Master
Source
Workday

Description

NVIDIA has continuously reinvented itself over two decades. NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world.

This is our life’s work — to amplify human imagination and intelligence. AI becomes more and more important in AI-City and self-driving car. NVIDIA is at the forefront of the AI-City and self-driving revolution and providing powerful solutions for them. All these solutions are based on GPU-accelerated libraries, such as CUDA, cuDNN and TensorRT, etc. Now, we are now looking for an CPU computing engineer based in Shanghai.

What you’ll be doing:

  • Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance

  • Performance analysis, optimization and tuning

  • Closely follow academic developments in the field of artificial intelligence and feature update TensorRT and TensorRT Edge LLM

  • Collaborate across the company to guide the direction of machine learning inferencing, working with software, research and product teams

What we need to see:

  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree (or equivalent experience)

  • 4+ years of relevant software development experience.

  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.

  • Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative models

  • Experience working with deep learning frameworks like PyTorch

  • Proactive and able to work without supervision

  • Excellent written and oral communication skills in English

  • Strong customer communication skills, powerfully motivated to provide highly responsive support as needed

#deeplearning

Skills

Machine LearningDeep LearningPyTorch

Similar Jobs

30

Senior Software Engineer - Python, Gen AI, LLM, Open AI

Wells Fargo · 111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India

2 days ago

Lead Software Engineer - Gen AI, Agentic AI, LLM, RAG

Wells Fargo · 111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India

3 days ago

Software Engineer, Artificial Intelligence/LLM (Multiple Seniority Levels)

Beaconai · San Carlos - Hybrid · Hybrid

4 days ago

Software Engineer, LLM Inference

Nvidia · Shanghai, Shanghai,CN, CN

1 week ago

Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (4 - 8 Years)

Cisco · IND-BANGALORE, India · Hybrid

1 week ago

Software Engineer II – Generative AI & LLM Platforms

Hewlett Packard Enterprise (HP) · San Juan, Puerto Rico, Puerto Rico · Remote, Hybrid

1 week ago

Software Engineer II – Generative AI & LLM Platforms

Hewlett Packard Enterprise (HP) · San Juan, Puerto Rico, Puerto Rico · Remote, Hybrid

1 week ago

Software Engineer II – Generative AI & LLM Platforms

Hewlett Packard Enterprise (HP) · San Juan, Puerto Rico, Puerto Rico · Remote, Hybrid

1 week ago

Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (8 - 12 Years)

Cisco · IND-BANGALORE, India · Hybrid

1 week ago

Agentic AI and LLM Applications Software Development Engineer, Senior

Booz Allen Hamilton · USA, DC, Washington (1301 K St), United States of America

3 weeks ago

Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

Cisco · IND-BANGALORE, India · Hybrid

1 month ago

Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

Cisco · IND-BANGALORE, India · Hybrid

1 month ago

Software Developer – API & AI/LLM

Spectris · Home Working, PL, Poland · Remote

1 month ago

Software Engineer — Distributed LLM Inference Systems

Intel · CHN - Minhang, China

1 month ago

Software Engineer — Distributed LLM Inference Systems

Intel · CHN - Minhang, China

1 month ago

Principal Software Engineer - LLM Optimization

JPMorgan Chase · Jersey City, NJ, United States, US

1 month ago

Principal Software Engineer - LLM Optimization

JP Morgan Chase · Jersey City, NJ, United States, US

1 month ago

AI Computing Software Development Engineer, TensorRT-LLM

Nvidia · Taiwan, Taipei +1

1 month ago

AI Computing Software Development Engineer, TensorRT-LLM

Nvidia · Taipei City,TW, TW +1

1 month ago

DL Performance Software Engineer - LLM Inference

Nvidia · Canada, Toronto

1 month ago

DL Performance Software Engineer - LLM Inference

Nvidia · Toronto, ON,CA, CA

1 month ago

Senior Lead Software Engineer - LLM Ops Platform Reliability

JPMorgan Chase · GLASGOW, LANARKSHIRE, United Kingdom, GB

1 month ago

Senior Lead Software Engineer - LLM Ops Platform Reliability

JP Morgan Chase · GLASGOW, LANARKSHIRE, United Kingdom, GB

1 month ago

Senior Software Engineer II - LLM Observability

Honeycomb · Remote - United States · Remote

1 month ago

LLM Engineer / LLM Application Engineer / Senior Software Engineer (m/w/d) – KI-Plattform & LLM-Integration – Vollzeit

KI Group · Bad Homburg vor der Höhe, Hessen +1 · Remote

2 months ago

LLM Engineer / LLM Application Engineer / Senior Software Engineer (m/w/d) – KI-Plattform & LLM-Integration – Werkstudent / Praktikant

KI Group · Bad Homburg vor der Höhe, Hessen +1 · Remote

2 months ago

Binance Accelerator Program - Software Engineer (Backend + AI/LLM)

Binance · Asia +2 · Remote

2 months ago

Senior Lead Software Engineer - Python/AWS/AI/LLM

JPMorgan Chase · Jersey City, NJ, United States, US

2 months ago

Senior Lead Software Engineer - Python/AWS/AI/LLM

JP Morgan Chase · Jersey City, NJ, United States, US

2 months ago

Lead Software Engineer - Full Stack/Generative AI/LLM

JP Morgan Chase · Plano, TX, United States, US

3 months ago