- Location
- Maharashtra, Pune
- Type
- Full-time
- Seniority
- Lead
- Source
- Freshteam
Description
Principal QA – AI & Conversational Systems
Company Overview:
At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results
Role Overview
Lead evaluation of AI-driven voice bots, agent assist, and summarization systems.
Design LLM validation frameworks ensuring accuracy, safety, and latency compliance.
Drive responsible AI and bias testing standards.
Core Responsibilities
Hallucination detection and response accuracy scoring.
RAG and knowledge grounding validation.
Synthetic call testing and AI load benchmarking.
Prompt robustness and fallback validation.
Sensitive data leakage and AI compliance testing.
Ideal Background
Experience in LLM or conversational AI testing.
Hands-on exposure to AI evaluation metrics.
Strong understanding of AI safety and bias validation.
Experience designing AI testing frameworks.