Hiring.Camp

Senior Inference Engineer

techire ai

·

Mar 3, 2026

Location
06
Workplace
Remote
Type
Full-time
Department
Engineering
Seniority
Senior
Closing date
Today
Source
Vincere

Description

Want to own the inference layer behind millions of real-world voice AI interactions every day?

You’ll join a profitable, founder-led enterprise conversational AI company powering billions of interactions annually across 30+ languages. Their systems sit behind major global brands and handle millions of customer conversations daily.

They’re now moving toward end-to-end multimodal and speech-to-speech architectures. You’ll own the inference stack powering both their multimodal speech-text LLM and their text reasoning LLM.

This goes well beyond tuning configs.

You will:

• Optimise production inference across A10, A100 and H100 GPUs
• Own scheduler design, KV cache allocation and batching logic
• Build serving systems tailored to multimodal audio-text workloads
• Support agentic, multi-step reasoning under real latency constraints
• Profile kernel-level bottlenecks and fix them properly

You’ve modified inference framework internals before, not just used them. You’re comfortable in Python and C++, and you’re happy diving into CUDA graphs, memory bandwidth limits or custom kernels when required.

This platform processes over 2 million interactions per day. Latency, throughput and cost are production realities, not lab metrics.

Package: €150,000 base + bonus + stock options
Location: Remote within Europe

If you want full ownership of inference performance at real enterprise scale, let’s talk.

All applicants will receive a response.

Skills

Python

Similar Jobs

30

Senior Inference Engineer

Careers Home·US

1mo ago

Sr. Inference Engineer (LLM Serving)

GoodData·Prague, Czechia·Hybrid

2d ago

Lead/Senior Inference Engineer

Thomson Reuters·Ann Arbor, Michigan +4·Remote

3d ago

Lead/Senior Engineer, Model Inference

Thomson Reuters·London, England +1·Hybrid

3d ago

Senior ML Systems Engineer - Productionization & Inference

Digitalturbine·Warsaw, Mazovia·Hybrid

3d ago

Senior Software Engineer Ai Foundry Core Bulk Inference

Accounts·Remote

Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai·Poland·Remote

3d ago

Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)

Akamai·Poland·Remote

3d ago

Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

Positron·US·Remote

1w ago

Performance Modeling Engineer, AI Inference Deployments (Senior/Principal)

Positron·US·Remote

1w ago

Senior Software Engineer, Inference Performance

Tensordyne·Berlin, State of Berlin +1

1w ago

Senior AI Research Engineer - LLM Training & Inference Infrastructure

Datadog·Paris, Île-de-France·Hybrid

Sr. Software Engineer, Training/Inference (C++)

xAI·Palo Alto, California +1

2w ago

Senior / Staff AI Research Engineer, Real-Time Inference

Roboforce·Milpitas, California·Onsite

2w ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·Kirkland, Washington·Hybrid

2w ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·San Diego, California·Hybrid

2w ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·Santa Clara, California·Hybrid

2w ago

Senior Machine Learning Engineer, Inference

Aida Projektai Mb·Mountain View, California·Remote, Onsite

2w ago

Senior Software Engineer — ML Inference & Numerics

Tensordyne·Berlin, State of Berlin +1

2w ago

Senior Inference Optimization ML Engineer

Rhoda Ai·Mountain View, California

2w ago

Senior AI/ML Engineer – SLM Optimization & Inference

Cnx·Nebraska, US·Remote

3w ago

(Senior/Junior AI Inference Reliability Engineer, Compute Infra

Together·San Francisco, California

3w ago

Senior Machine Learning Engineer, Inference

Inworld AI·Mountain View, California

4w ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·Santa Clara, California +1·Remote

1mo ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·New York City, New York +1·Remote

1mo ago

(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure

Together·San Francisco, California

1mo ago

Senior IA Inference Engineer (x/f/m)

Doctolib·Paris, Île-de-France·Hybrid

1mo ago

Senior II Platform Engineer Lead - Akamai Inference Cloud - Remote/Poland

Akamai·Poland·Remote

1mo ago

Senior Staff Inference Performance Engineer

D Matrix·Santa Clara, Villa Clara Province·Hybrid

1mo ago

Senior/Staff Back-End Software Engineer, Inference

Cohere·Montréal, Quebec +4·Remote

1mo ago