Hiring.Camp

Senior Inference Engineer

techire ai

·

Mar 3, 2026

Location
06
Workplace
Remote
Type
Full-time
Department
Engineering
Seniority
Senior
Closing date
Today
Source
Vincere

Description

Want to own the inference layer behind millions of real-world voice AI interactions every day?

You’ll join a profitable, founder-led enterprise conversational AI company powering billions of interactions annually across 30+ languages. Their systems sit behind major global brands and handle millions of customer conversations daily.

They’re now moving toward end-to-end multimodal and speech-to-speech architectures. You’ll own the inference stack powering both their multimodal speech-text LLM and their text reasoning LLM.

This goes well beyond tuning configs.

You will:

• Optimise production inference across A10, A100 and H100 GPUs
• Own scheduler design, KV cache allocation and batching logic
• Build serving systems tailored to multimodal audio-text workloads
• Support agentic, multi-step reasoning under real latency constraints
• Profile kernel-level bottlenecks and fix them properly

You’ve modified inference framework internals before, not just used them. You’re comfortable in Python and C++, and you’re happy diving into CUDA graphs, memory bandwidth limits or custom kernels when required.

This platform processes over 2 million interactions per day. Latency, throughput and cost are production realities, not lab metrics.

Package: €150,000 base + bonus + stock options
Location: Remote within Europe

If you want full ownership of inference performance at real enterprise scale, let’s talk.

All applicants will receive a response.

Skills

Python

Similar Jobs

30

Senior Inference Engineer

Careers Home·US

3w ago

Senior AI Research Engineer - LLM Training & Inference Infrastructure

Datadog·Paris, Île-de-France·Hybrid

Sr. Software Engineer, Training/Inference (C++)

xAI·Palo Alto, California +1

5d ago

Senior / Staff AI Research Engineer, Real-Time Inference

Roboforce·Milpitas, California·Onsite

5d ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·Kirkland, Washington·Hybrid

6d ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·San Diego, California·Hybrid

6d ago

Senior Staff Software Engineer - AI/ML Inference Engineering

ServiceNow·Santa Clara, California·Hybrid

6d ago

Senior Machine Learning Engineer, Inference

Aida Projektai Mb·Mountain View, California·Remote, Onsite

6d ago

Senior Software Engineer — ML Inference & Numerics

Tensordyne·Berlin, State of Berlin +1

1w ago

Senior Inference Optimization ML Engineer

Rhoda Ai·Mountain View, California

1w ago

Senior Machine Learning Engineer, SageMaker Inference

Amazon Company·Remote

(Senior/Junior AI Inference Reliability Engineer, Compute Infra

Together·San Francisco, California

2w ago

Senior Machine Learning Engineer, Inference

Inworld AI·Mountain View, California

2w ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·New York City, New York +1·Remote

3w ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

Nvidia·Santa Clara, California +1·Remote

3w ago

(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure

Together·San Francisco, California

3w ago

Senior IA Inference Engineer (x/f/m)

Doctolib·Paris, Île-de-France

3w ago

Senior IA Inference Engineer (x/f/m)

Doctolib·Paris, Île-de-France·Hybrid

3w ago

Senior II Platform Engineer Lead - Akamai Inference Cloud - Remote/Poland

Akamai·Poland·Remote

3w ago

Senior Staff Inference Performance Engineer

D Matrix·Santa Clara, Villa Clara Province·Hybrid

3w ago

Senior/Staff Back-End Software Engineer, Inference

Cohere·Montréal, Quebec +4·Remote

3w ago

Senior Customer Support Engineer - Managed Inference

Crusoe·Denver, Colorado·Onsite

4w ago

Senior Customer Support Engineer - Managed Inference

Crusoe·New York, US +1·Onsite

4w ago

Senior/Staff Software Engineer - LLM Inference Systems & Open-Source

Qualcomm·San Diego, California +1

4w ago

Sr. Inference Service SRE & Automation Engineer

Bitdeer Technologies Group

Senior Deep Learning Software Engineer, Inference and Model Optimization

Nvidia·New York City, New York +1·Remote

1mo ago

Senior Deep Learning Software Engineer, Inference and Model Optimization

Nvidia·New York City, New York +1·Remote

1mo ago

Senior Java Software Engineer - Search Inference - Platform

Elastic·Lisbon, Portugal +1

Senior Java Software Engineer - Search Inference - Platform

Elastic·London, England +1

Senior Java Software Engineer - Search Inference - Platform

Elastic·Athens, Attica +1