ML QA - ISV
Virtusa
Office
AP
Full Time
ML QA - ISV - (CREQ231349)
Test Engineer to validate agent output quality, automate regression, and perform hallucination testing.
Experience Level: 5+ years
JD
Design and execute functional and exploratory test cases.
Validate LLM outputs and context alignment.
Automate regression tests using Python frameworks.
Track success rate, response time, hallucination %.
Perform agent A/B testing and red teaming.
Experience with AI/ML or chatbot testing.
Familiarity with Pytest, Robot Framework.
Knowledge of LLM output evaluation techniques.
Experience with annotation and human-in-the-loop testing.
Description
Job Summary:Test Engineer to validate agent output quality, automate regression, and perform hallucination testing.
Experience Level: 5+ years
JD
Design and execute functional and exploratory test cases.
Validate LLM outputs and context alignment.
Automate regression tests using Python frameworks.
Track success rate, response time, hallucination %.
Perform agent A/B testing and red teaming.
Experience with AI/ML or chatbot testing.
Familiarity with Pytest, Robot Framework.
Knowledge of LLM output evaluation techniques.
Experience with annotation and human-in-the-loop testing.
Primary Location
: IN-AP-HyderabadSchedule
: Full TimeEmployee Status
: Individual ContributorJob Type
: ExperiencedTravel
: NoJob Posting
: 08/09/2025, 10:25:40 AMML QA - ISV
Office
AP
Full Time
September 8, 2025