Lead Quality Assurance Engineer

Job Title: 

Technical Lead – Software Quality Assurance (QA) 

Location: 

India 

Experience: 

10 to 12 years 

Job Summary 

We are looking for a dynamic and visionary Technical Lead in Quality Assurance to lead end-to-end quality initiatives across both traditional software systems and next-generation Generative AI / Agentic AI technologies. This role requires strong expertise in QA strategy, automation, AI/LLM evaluation, and team leadership. The ideal candidate will be responsible for defining test approaches, mentoring teams, driving process improvement, and ensuring the delivery of high-quality software and AI solutions within time and budget. 

Key Responsibilities 

QA Strategy & Leadership 

• Define and execute QA strategy across software products including GenAI agents, LLM-based tools, APIs, and web/mobile applications. 

• Establish and monitor quality goals, test coverage, release readiness, and risk-based validation plans for AI and traditional systems. 

• Drive test architecture and frameworks for both functional and AI-specific evaluations. 

• Ensure best practices in STLC, SDLC, Agile methodologies, and CI/CD processes. 

• Maintain and report test execution metrics, defect leakage, test effectiveness, and quality KPIs. 

• Collaborate with cross-functional stakeholders across engineering, product, and data science teams to align quality goals. 

Team & Process Management 

• Manage, mentor, and grow a team of QA engineers, automation experts, and analysts. 

• Conduct performance reviews, skill-gap analysis, and career planning for team members. 

• Support recruitment, onboarding, and scaling of the QA team. 

• Foster a culture of continuous improvement, innovation, accountability, and learning. 

• Facilitate effective internal and external communication regarding project updates, risks, and timelines. 

Automation & Tooling 

• Lead development of test automation strategies using tools such as Selenium, Playwright, Cypress, Robot Framework. 

• Integrate automation into CI/CD pipelines using tools like Jenkins, GitHub Actions, etc. 

• Design and maintain performance testing frameworks using tools such as JMeter, LoadRunner, and SoapUI. 

• Incorporate GenAI-specific test tools like DeepEval, PromptLayer, and LLM observability tools into automation pipelines. 

• Apply basic scripting knowledge (Python/Java) for framework customization and tool integration. 

AI/GenAI/Agentic Evaluation 

• Design robust evaluation frameworks for GenAI/LLM systems including: 

• Output accuracy, hallucination detection, factual consistency. 

• Prompt testing, adversarial scenarios, and edge case validation. 

• Collaborate with AI/ML teams to define evaluation hooks, model behaviors, benchmarking standards, and observability. 

• Use AI to generate and maintain test scenarios for intelligent systems. 

Essential Skills & Qualifications 

• Bachelor’s/Master’s degree in Computer Science, Engineering, or related field. 

• 10+ years of QA experience with at least 4+ years in a leadership/managerial capacity. 

• Proven experience in building and scaling automation frameworks and QA practices. 

• Hands-on experience with Generative AI model behaviors (e.g., GPT-4, Claude, RAG pipelines, LLMs). 

• Strong understanding of Agile/Scrum methodologies, DevOps pipelines, CI/CD processes. 

• Familiarity with test management tools and requirement traceability processes. 

• Ability to interpret and assess software requirements, perform impact analysis, and contribute to high-quality test design. 

• Deep understanding of quality assurance artifacts including test plans, test cases, test data, and defect life cycle. 

Preferred Qualifications 

• ISTQB or equivalent certification. 

• Familiarity with cloud platforms (AWS, Azure). 

• Hands-on experience with AI-driven test case generation and maintenance. 

• Ability to design automation and performance strategies independently. 

• Strong understanding of OOP concepts, database queries, and systems integration. 

• Excellent analytical, communication, presentation, and leadership skills. 

• Demonstrated ability to mentor, coach, and manage teams with empathy and efficiency. 

This role offers a unique opportunity to be at the forefront of software quality assurance — combining traditional QA excellence with AI-driven innovation. If you're passionate about quality and future-facing technologies, we'd love to hear from you.