Hiring.Camp

Senior Inference Engineer

techire ai

·

Mar 3, 2026

Location
06
Workplace
Remote
Type
Full-time
Department
Engineering
Seniority
Senior
Closing date
Today
Source
Vincere

Description

Want to own the inference layer behind millions of real-world voice AI interactions every day?

You’ll join a profitable, founder-led enterprise conversational AI company powering billions of interactions annually across 30+ languages. Their systems sit behind major global brands and handle millions of customer conversations daily.

They’re now moving toward end-to-end multimodal and speech-to-speech architectures. You’ll own the inference stack powering both their multimodal speech-text LLM and their text reasoning LLM.

This goes well beyond tuning configs.

You will:

• Optimise production inference across A10, A100 and H100 GPUs
• Own scheduler design, KV cache allocation and batching logic
• Build serving systems tailored to multimodal audio-text workloads
• Support agentic, multi-step reasoning under real latency constraints
• Profile kernel-level bottlenecks and fix them properly

You’ve modified inference framework internals before, not just used them. You’re comfortable in Python and C++, and you’re happy diving into CUDA graphs, memory bandwidth limits or custom kernels when required.

This platform processes over 2 million interactions per day. Latency, throughput and cost are production realities, not lab metrics.

Package: €150,000 base + bonus + stock options
Location: Remote within Europe

If you want full ownership of inference performance at real enterprise scale, let’s talk.

All applicants will receive a response.

Skills

Python

Similar Jobs

30

Sr. Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Amazon·Remote

4d ago

Senior Staff Applied AI Inference Engineer

Crusoe·San Francisco, CA - US·Onsite

4d ago

Senior System Software Engineer - Dynamo-Triton Inference Server

Nvidia·Santa Clara, CA +2·Remote

1w ago

Senior System Software Engineer - Dynamo-Triton Inference Server

Nvidia·Santa Clara, CA +2·Remote

1w ago

Senior Software Engineer, Inference

Hewlett Packard Enterprise (HP)·Spring, Texas +2·Remote, Hybrid

1w ago

Senior Software Engineer, Inference

Hewlett Packard Enterprise (HP)·Spring, Texas +2·Remote, Hybrid

1w ago

Senior Software Engineer, Inference

Hewlett Packard Enterprise (HP)·Spring, Texas +2·Remote, Hybrid

1w ago

Sr. Software Development Engineer, Inference Team - AWS Neuron

Amazon·Remote

1w ago

Senior Infrastructure Engineer (ML Inference)

Artificial.Agency·Edmonton +1·Remote

1w ago

Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization

DiDi Research America·San Jose, CA +1

2w ago

Senior Software Engineer, Inference

AssemblyAI

2w ago

Senior Software Engineer, Inference

AssemblyAI

2w ago

Sr. Software Engineer, AI / ML Inference Platform

Dialpad·Buenos Aires, Argentina +1

2w ago

Sr. AI Engineer (AI/ML Inference)

Dialpad·Vancouver, Canada +1

3w ago

Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs

Amazon

3w ago

Senior Lead Software Engineer- Inference platform engineer

JPMorgan Chase·Seattle, WA

3w ago

Senior Lead Software Engineer- Inference platform engineer

JP Morgan Chase·Seattle, WA

3w ago

Senior Software Engineer (AI Inference & Runtime Platform)

AZX·Seattle·Remote

3w ago

Senior Software Engineer, Inference

Assemblyai·UK·Remote

4w ago

Senior Software Engineer, Inference

Assemblyai·North America·Remote

4w ago

Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Amazon·Remote

4w ago

Senior Applied Scientist / Engineer, Training & Inference

Adobe·San Jose, US

1mo ago

Staff + Senior Software Engineer, Inference

Anthropic·Ontario, CAN +1·Remote

1mo ago

Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron

Amazon·Remote

1mo ago

Senior Deep Learning Software Engineer, Inference

Nvidia·Netherlands, Remote +2·Remote

1mo ago

Senior Deep Learning Software Engineer, Inference

Nvidia·NL +2·Remote

1mo ago

Senior System Software Engineer, Agentic Inference - Dynamo

Nvidia·Santa Clara, CA +1·Remote

2mo ago

Senior Inference Engineer, GPU Kernel Optimization

Nvidia·Santa Clara, CA +3

2mo ago

Senior System Software Engineer, Agentic Inference - Dynamo

Nvidia·Santa Clara, CA +1·Remote

2mo ago

Senior Inference Engineer, GPU Kernel Optimization

Nvidia·Santa Clara, CA +3

2mo ago