Hiring.Camp

Machine Learning Engineer

Convin.AI

·

4 days ago

Location
Bengaluru, India
Department
Engineering
Seniority
Mid
Source
Keka

Description

Machine Learning Engineer: Speech & Language Models

Company: Convin.ai
Location: Bengaluru
Experience: 2-5 years

About the role

We're building conversational AI and voicebot systems that run in production at scale, across multiple Indian languages and code-mixed speech. We're looking for an ML Engineer who is comfortable across both speech and text, can own models from training through to serving, and enjoys exploring new model families and turning them into reliable production systems.

You'll work on small language models (SLMs) tailored to our tasks, the inference infrastructure that serves them, and a new initiative to explore and train our own text-to-speech (TTS) model.

What you'll do

Small language models
- Fine-tune, distill, and maintain custom SLMs for company-specific tasks such as call analysis, structured extraction, and agent reasoning.
- Build and curate training and evaluation datasets, including synthetic data generation and labeling pipelines.
- Run systematic evaluations against task-specific metrics and larger reference models, and iterate on quality, latency, and cost.
- Apply model optimization techniques such as quantization, knowledge distillation, and LoRA/QLoRA fine-tuning.

LLM serving infrastructure
- Own and improve our LLM serving stack built on NVIDIA Triton Inference Server, vLLM, SGLang, and NVIDIA Dynamo, including deployment, scaling, and capacity planning across GPUs.
- Tune inference for low-latency, high-concurrency voice workloads: batching, prefix/KV caching, quantized weights, and speculative decoding where useful.
- Maintain routing, health checks, and fallbacks across model backends, and build observability (metrics, dashboards, alerts) for production models.
- Debug production issues end to end, from GPU memory and throughput problems to tool-calling and output-format reliability.

Speech: ASR and TTS
- Work with ASR systems for multilingual and code-mixed audio, including evaluation, fine-tuning, and transcript quality improvements.
- Survey and benchmark open-source TTS models for naturalness, latency, streaming support, and language coverage.
- Lead the training of an in-house TTS model: data collection and cleaning, speaker and prosody considerations, training, evaluation (MOS, intelligibility, latency), and deployment for real-time voice agents.

What we're looking for

Must have
- Strong Python and PyTorch skills, with hands-on experience training or fine-tuning transformer models.
- Practical experience with LLM fine-tuning and evaluation (Hugging Face ecosystem, PEFT, or similar).
- Experience deploying models to production and reasoning about latency, throughput, and GPU cost.
- Hands-on experience with at least one of Triton Inference Server, vLLM, or SGLang in production.
- Comfort working with messy real-world data and building data pipelines around it.
- Ability to read papers, try new approaches quickly, and report results clearly.

Good to have
- Experience with speech models: ASR (Whisper-style, CTC/RNN-T) or TTS (VITS, FastSpeech, flow-matching or codec-based models).
- Experience with NVIDIA Dynamo or other distributed inference frameworks (disaggregated prefill/decode, KV-cache-aware routing).
- Experience with Indian languages or code-mixed text and speech.
- Knowledge of quantization formats (FP8, AWQ, GPTQ) and distributed training (FSDP, DeepSpeed).
- Experience with observability tooling (Prometheus, Grafana) and containerized deployments (Docker, Kubernetes).
- Open-source contributions or published work in NLP or speech.

Skills

PythonDockerKubernetesMachine LearningNLPPyTorchLLM

Similar Jobs

30

Machine Learning Engineer

Modjo·Paris, Île-de-France

Today

Machine Learning Engineer

Workday·Pleasanton, California·Hybrid

1d ago

Machine Learning Engineer

Weekday AI·Delhi, India·Onsite

1d ago

Machine Learning Engineer

Trainingbasket·Noida, Uttar Pradesh

1d ago

Machine learning Engineer

SIA·Maastricht, Limburg·Hybrid

2d ago

Machine Learning Engineer

SIA·Brussels, Brussels Capital·Hybrid

2d ago

Machine learning Engineer

SIA·Rotterdam, South Holland·Hybrid

2d ago

Machine Learning Engineer

SIA·Antwerp, Ohio·Hybrid

2d ago

Machine learning Engineer

SIA·Amsterdam, North Holland·Hybrid

2d ago

Machine Learning Engineer

Ford·Dearborn, Michigan·Hybrid

5d ago

Machine Learning Engineer

USA01 - USA Automotive·Dearborn, Michigan·Hybrid

5d ago

Machine Learning Engineer

Fabuwood·Newark, New Jersey

5d ago

Machine Learning Engineer

Claylabs·San Francisco, California·Hybrid

1w ago

Machine Learning Engineer

"Arena Intelligence, Inc."·SF Bay Area·Hybrid

1w ago

Machine Learning Engineer

"Voyager Technologies, Inc."·El Segundo, California

1w ago

Machine Learning Engineer

The Faculty·London, England·Hybrid

1w ago

Machine Learning Engineer

Poshmark·IN Tamil Nadu - Office

1w ago

Machine Learning Engineer

Endava·Córdoba, Cordoba·Hybrid

1w ago

Machine Learning Engineer

Endava·Rosario, Santa Fe·Remote

1w ago

Machine Learning Engineer

Cisco·India·Remote

1w ago

Machine Learning Engineer

Vitol·Houston, Texas·Onsite

1w ago

Machine Learning Engineer

Imc·Remote

1w ago

Machine Learning Engineer

PlayStation Global·Zaventem, Flanders·Remote, Hybrid

1w ago

Machine Learning Engineer

Experian·Sofia, Sofia-Capital

1w ago

Machine Learning Engineer

Coframe·SF Bay Area·Onsite

1w ago

Machine Learning Engineer

Arabic.AI·Riyadh, Riyadh Region

Machine Learning Engineer

The Faculty·Melbourne, Victoria +1·Hybrid

1w ago

Machine Learning Engineer

Averis·Kuala Lumpur, Malaysia

2w ago

Machine Learning Engineer

Central Insurance Company·Alpharetta, Georgia +4·Hybrid

2w ago

Machine Learning Engineer

Kavak·Lahore, Punjab

2w ago