- Location
- Pune, MH,IN, IN
- Type
- Full-time
- Department
- Engineering
- Education
- Bachelor
- Source
- Eightfold
Description
We are seeking a skilled Software QA Test Developer to join our test development team passionate about Conversational AI products. This is an outstanding opportunity to be part of NVIDIA's legacy of innovation and help develop the future of computing powered by AI. In this role, you will own quality for NVIDIA's voice AI pipelines — end-to-end systems integrating ASR, LLM, and TTS models built on open-source frameworks and NVIDIA NIM microservices. You will compose test strategies, build AI-powered test automation, and drive CI pipeline reliability across multi-model, multi-agent voice systems deployed on cloud, workstation, and edge targets.
What you'll be doing:
- Develop and sustain CI/CD pipelines for voice agent projects, automating build, deploy, and test workflows across cloud and GPU deployment profiles.
- Develop Python-based test frameworks to validate cascaded voice pipelines (ASR → LLM → TTS), including latency, accuracy, and interruption-handling scenarios.
- Track and improve code coverage across Conversational AI codebases; identify gaps and add targeted unit, integration, and end-to-end tests.
- Build and complete test plans for multi-agent orchestration, tool-calling workflows, and multimodal (audio/video/image) understanding features.
- Evaluate and benchmark Conversational AI models for accuracy, efficiency, and latency using project evaluation frameworks.
- Develop AI agents and LLM-powered workflows to automate repetitive QA tasks such as log analysis, regression triage, and test-case generation.
- Identify, document, and regress bugs across the full stack — from containerized deployments and NIM microservices to the frontend client.
- Collaborate with engineering and release teams to review feature requirements, specifications, and technical build documents.
What we need to see:
- B.Tech. or M.Tech. or equivalent degree in CS/CE/IT/ECE/EEE.
- 2+ years of hands-on testing experience in software/embedded systems.
- Strong programming skills in Python; ability to write test frameworks and automation scripts from scratch.
- Proficiency in Linux environments, shell scripting, and command-line debugging.
- Hands-on experience with LLMs and Conversational AI systems (ASR, TTS, or NLP pipelines).
- Proven experience developing or collaborating with AI Agents and agentic workflows (e.g., LangChain, Pipecat, or comparable frameworks).
- Experience crafting and maintaining CI/CD pipelines (GitHub Actions, Jenkins, or similar) and managing daily automation tasks.
- Strong understanding of QA processes — code coverage tracking, test planning, regression management, and bug lifecycle.
- Working knowledge of Docker, Docker Compose, and container-based deployments.
Ways to stand out from the crowd:
- Experience testing real-time streaming or voice/audio pipelines.
- Experience with NVIDIA NIM microservices, NGC, or GPU-accelerated inference.
- Hands-on with Kubernetes or edge deployment platforms (Jetson, DGX Spark).
- Any degree/certification in Machine Learning or Artificial Intelligence.
We offer competitive salaries and a generous benefits package. We are known as one of the world's most desirable technology employers. Our teams include some of the most forward-thinking and hardworking people globally. Due to outstanding growth, our engineering teams are rapidly expanding. If you are a creative and independent engineer with a strong passion for technology, we want to hear from you!
