QA Engineer ( AI/ML) (Onsite, Hebbal)

We’re seeking a QA Manual Tester with 2–4 years of experience and a strong grasp of software QA and AI/ML testing. You’ll design and execute manual tests, validate model performance, and ensure data quality using tools like Python, SQL, TensorFlow, and AWS SageMaker. This role includes cross-team collaboration and may require occasional on-call availability.

Key Responsibilities: 

• Evaluate and perform manual functional, regression, and integrated testing against new or modified software programs and procedures used to verify that programs function according to requirements and conform to establishment guidelines. 

• Write, revise, and verify test plans and test procedures for program defect identification, environment needs, and product feature evaluations. 

• Evaluate, generate, execute, and maintain full active test library, with limited redundancy, with test scenarios to ensure requirements coverage and regression coverage with positive and negative testing in accordance with set processes and procedures and methodology. 

• Participate in product design reviews to provide input on functional requirements, product designs, usability, or testing implications. 

• Identify, report, and track product defects as well as address need for additional product functionality in a clear and concise form. 

• Prepare and/or review end user and technical documentation generated for accuracy, completeness, and overall quality. 

• Provide estimation of tasks, and on-time delivery against stated schedules. 

• This position may require availability outside of standard business hours as part of a rotational on-call schedule 

What You’ll Need to Be Successful (Required Skills): 

• 2-4 Years in QA Manual 

• Strong understanding of technology, software quality assurance standards and practices with a natural inquisitiveness. 

• Strong written and verbal communication with active listening skills and the ability to interact with a wide variety of technical and non-technical personnel via matrix navigation. 

• Ability to logically identify issues using a level of abstraction and troubleshooting, and problem-solving skills and prediction where necessary in identifying defects, test coverage, and gaps in requirements. 

• Ability to read and interpret business requirements and read, write and identify test specifications, test plans, and test scenarios. 

• Ability to balance individual and team effort in collaborative processes while meeting deadlines. Strong written and detail-oriented skills to effectively produce quality test cases and related test and release documentation with a high level of coverage. 

• Understanding of AI/ML Fundamentals: Knowledge of machine learning concepts including supervised/unsupervised learning, neural networks, deep learning architectures, and common algorithms (regression, classification, clustering). 

• Data Quality Assessment: Experience in evaluating training data quality, identifying data bias, handling missing data, and understanding data preprocessing techniques that impact model performance. 

• Model Performance Testing: Ability to design and execute test cases for model accuracy, precision, recall, F1-score, and other relevant metrics across different datasets and edge cases. 
• AI/ML Testing Tools Familiarity: Experience with testing frameworks and tools specific to AI/ML such as MLflow, pytest for Python testing, and AWS SageMaker for model validation and monitoring. 
• Bias and Fairness Testing: Understanding of how to test for algorithmic bias, fairness across different demographic groups, and ethical AI considerations in model behavior. 
• Programming Skills for AI/ML Testing: Proficiency in Python and SQL for creating test scripts, data manipulation, and working with ML libraries (scikit-learn, TensorFlow, PyTorch) to validate model implementations and query training/test datasets. 
• MLOps and Model Lifecycle Testing: Experience with testing ML models in production environments using AWS cloud services, including A/B testing for model versions, monitoring model drift, and validating continuous integration/continuous deployment (CI/CD) pipelines for ML systems 

Education/ Certifications: 

• Bachelor’s degree in computer science, Engineering, or a related field, or equivalent relevant experience. 

Preferred Skills: 

• Experience with structured delivery processes 

• Experience with full lifecycle development and using Agile methods 

• Experience in working with web-based, pc-based, and mobile applications built with Java, Delphi, .Net, Objective C platforms on Windows, Linux, iOS environments utilizing varying databases for data storage and retrieval. 

• At least 1 year of experience writing manual test cases, test plans, and test execution 

• Knowledge of where test automation applies, its usage, and maintenance needs. 

Why Join Us? 

At Netsmart you’ll work on exciting challenges that shape the future of healthcare. You’ll have the opportunity to: 

• Collaborate with talented professionals passionate about technology. 

• Work in a supportive and inclusive environment where your growth is prioritized. 

• Access professional development opportunities, including certifications and training. 

• Enjoy a competitive compensation package and comprehensive benefits. 

Netsmart is proud to be an equal opportunity workplace and is an affirmative action employer, providing equal employment and advancement opportunities to all individuals. We celebrate diversity and are committed to creating an inclusive environment for all associates. All employment decisions at Netsmart, including but not limited to recruiting, hiring, promotion and transfer, are based on performance, qualifications, abilities, education and experience. Netsmart does not discriminate in employment opportunities or practices based on race, color, religion, sex (including pregnancy), sexual orientation, gender identity or expression, national origin, age, physical or mental disability, past or present military service, or any other status protected by the laws or regulations in the locations where we operate.

Netsmart desires to provide a healthy and safe workplace and, as a government contractor, Netsmart is committed to maintaining a drug-free workplace in accordance with applicable federal law. Pursuant to Netsmart policy, all post-offer candidates are required to successfully complete a pre-employment background check, which is provided at Netsmart’s sole expense.