Hiring.Camp

Senior Inference Engineer

techire ai

·

Mar 3, 2026

Location
06
Workplace
Remote
Type
Full-time
Department
Engineering
Seniority
Senior
Closing date
Today
Source
Vincere

Description

Want to own the inference layer behind millions of real-world voice AI interactions every day?

You’ll join a profitable, founder-led enterprise conversational AI company powering billions of interactions annually across 30+ languages. Their systems sit behind major global brands and handle millions of customer conversations daily.

They’re now moving toward end-to-end multimodal and speech-to-speech architectures. You’ll own the inference stack powering both their multimodal speech-text LLM and their text reasoning LLM.

This goes well beyond tuning configs.

You will:

• Optimise production inference across A10, A100 and H100 GPUs
• Own scheduler design, KV cache allocation and batching logic
• Build serving systems tailored to multimodal audio-text workloads
• Support agentic, multi-step reasoning under real latency constraints
• Profile kernel-level bottlenecks and fix them properly

You’ve modified inference framework internals before, not just used them. You’re comfortable in Python and C++, and you’re happy diving into CUDA graphs, memory bandwidth limits or custom kernels when required.

This platform processes over 2 million interactions per day. Latency, throughput and cost are production realities, not lab metrics.

Package: €150,000 base + bonus + stock options
Location: Remote within Europe

If you want full ownership of inference performance at real enterprise scale, let’s talk.

All applicants will receive a response.

Skills

Python

Similar Jobs

30

Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron

Amazon · Remote

Today

Senior Deep Learning Software Engineer, Inference

Nvidia · Netherlands, Remote +2 · Remote

2 days ago

Senior Deep Learning Software Engineer, Inference

Nvidia · NL +2 · Remote

2 days ago

Sr. Software Engineer - Inference Engine (Platform Software)

Furiosa Ai · Seoul HQ

2 days ago

Senior System Software Engineer, Agentic Inference - Dynamo

Nvidia · Santa Clara, CA,US, US +1 · Remote

2 weeks ago

Senior Inference Engineer, GPU Kernel Optimization

Nvidia · Santa Clara, CA,US, US +3

2 weeks ago

Senior System Software Engineer, Agentic Inference - Dynamo

Nvidia · US, CA, Santa Clara, United States of America +1 · Remote

2 weeks ago

Senior Inference Engineer, GPU Kernel Optimization

Nvidia · US, CA, Santa Clara, United States of America +3

2 weeks ago

Sr. Inference Optimization Engineer (local / edge runtime)

Intel · USA - CA - Santa Clara, United States of America +3 · Hybrid

2 weeks ago

Sr. Inference Optimization Engineer (local / edge runtime)

Intel · USA - CA - Santa Clara, United States of America +3 · Hybrid

2 weeks ago

Senior Software Engineer, Quantized Inference

Nvidia · Redmond, WA,US, US +1

3 weeks ago

Senior Software Engineer, Quantized Inference

Nvidia · US, WA, Redmond, United States of America +1

3 weeks ago

Sr. Lead AI Engineer (FM Hosting, LLM Inference)

Capitalone · New York, NY, United States of America +3

3 weeks ago

Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.Ai · Redwood City · Hybrid

4 weeks ago

Senior System Software Engineer - AI Data Platform - Inference Factory Optimization

Nvidia · Hanoi, Hanoi,VN, VN +1 · Remote

1 month ago

Senior Deep Learning Software Engineer, Inference

Nvidia · CA,US, US +4 · Remote

1 month ago

Senior System Software Engineer - AI Data Platform - Inference Factory Optimization

Nvidia · Vietnam, Hanoi +1 · Remote

1 month ago

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capitalone · New York, NY, United States of America +3

1 month ago

Staff + Senior Software Engineer, Inference Deployment

Anthropic · San Francisco, CA | New York City, NY | Seattle, WA +1 · Onsite

1 month ago

Senior Software Engineer, Inference

Pika · Palo Alto HQ · Onsite

1 month ago

Senior Security Engineer - Akamai Inference Cloud - Remote/Poland

Akamai · Poland, PL · Remote

2 months ago

Staff + Senior Software Engineer, Inference

Anthropic · San Francisco, CA | New York City, NY | Seattle, WA +1 · Onsite

2 months ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic · San Francisco, CA +1 · Onsite

2 months ago

Staff + Sr. Software Engineer, Cloud Inference

Anthropic · San Francisco, CA +1 · Onsite

2 months ago

Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)

Capitalone · San Jose, CA, United States of America +4

2 months ago

Senior Deep Learning Research Engineer, LLM Inference

Nvidia · Israel, Tel Aviv

3 months ago

Senior Deep Learning Research Engineer, LLM Inference

Nvidia · Tel Aviv-Yafo, Tel Aviv District,IL, IL

3 months ago

Senior Site Reliability Engineer, AI Inference

Ffive · Dublin, Ireland · Hybrid

3 months ago

Senior DL Algorithms Engineer - Inference Performance

Nvidia · US, CA, Santa Clara, United States of America +1 · Remote

3 months ago

Senior DL Algorithms Engineer - Inference Performance

Nvidia · Santa Clara, CA,US, US +1 · Remote

3 months ago