About this role
Full Time Mid-level Manual QA Engineer (Middle) ID51808 in education at AgileEngine in Ljubljana-Šmartno, Slovenia. Apply directly through the link below.
At a glance
- Work mode
- Office
- Employment
- Full Time
- Location
- Ljubljana-Šmartno, Slovenia
- Experience
- Mid-level · 2+ years
Core stack
- Documentation
- Performance
- Mentorship
- Compliance
- LangChain
- Jenkins
- Postman
- OpenAI
- Design
- Remote
- Azure
- CI/CD
- Agile
- Jira
- LLMs
- GDPR
- API
- ML
- UI
Quick answers
What skills are required?
Documentation, Performance, Mentorship, Compliance, LangChain, Jenkins, Postman, OpenAI, Design, Remote, and more.
AgileEngine is hiring for this role. Visit career page
Ljubljana, Slovenia
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Manual QA Engineer
to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You’ll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.
WHAT YOU WILL DO
- Perform manual testing of web applications to identify bugs, glitches, and inconsistencies;
- Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;
- Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.;
- Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements;
- Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs;
- Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate);
- Conduct manual API testing to validate request/response accuracy, error handling, and integration;
- Use TestRail to create, manage, and track test plans, test cases, and test execution results;
- Use Jenkins CI/CD pipelines;
- Report and document defects clearly using the bug tracking system (JIRA);
- Participate in daily stand-ups, sprint planning, and other Agile team meetings;
- Review user stories and acceptance criteria to understand the scope of testing;
- Estimate own tasks, report on risks to the team lead;
- Collaborate with developers and other QA team members to reproduce issues and verify fixes;
- Maintain and update test documentation as needed.
MUST HAVES
-
2+ years of experience with manual testing
;
- Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models;
- Knowledge of Testing and Quality Assurance Processes;
- Strong experience with Test Design activities to cover a set of product requirements;
- Knowledge of Test Design techniques;
- Knowledge of testing methodologies;
- Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes;
- Experience with
Postman
(API testing) and Browser developer tools;
- Experience with
UI testing;
- Understanding of
LLM evaluation principles,
including prompt engineering, output validation, and model fine-tuning cycles;
- Familiarity with AI/ML concepts, APIs, and frameworks (e.g.,
OpenAI API, Azure OpenAI, LangChain
);
- Knowledge of data protection and compliance standards for
AI systems
(GDPR, zero-data retention, PII anonymization);
- Experience with
TestRail
as a Test Management system (as a user, test execution is required);
- Basic understanding of CI/CD process;
-
Upper-intermediate English level
.
NICE TO HAVES
- Experience with SSO testing;
- Experience in Performance or Load.
PERKS AND BENEFITS
-
Professional growth:
Mentorship, TechTalks, and personalized growth roadmaps.
-
Competitive compensation:
USD-based pay with education, fitness, and team activity budgets.
-
Exciting projects:
Modern solutions with Fortune 500 and top product companies.
-
Flextime:
Flexible schedule with remote and office options.
Meet Our Recruitment Process
It includes main stages:
Application â Coding Challenge â Video Interview â Technical Interview or Interview with the Hiring Manager(s).
Each step helps us understand your skills and overall fit.
If it’s a match, you’ll receive an offer.