Search Satisfaction Grader

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact servicedesk@welocalize.com subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank You!

NOTICE:  For EMEA Jobs, please review the Privacy Policy here

Job Responsibilities:

The primary responsibility of this role is to evaluate search results returned by an AI Assistant, ensuring they meet user intent, relevance, and contextual appropriateness according to established guidelines.

Main Tasks & Responsibilities

The ideal candidate will possess strong analytical skills, excellent reading comprehension skills, a keen eye for detail, and the ability to provide insightful feedback to improve search functionalities.

Key Responsibilities:

• Analyzes user queries to determine intent and possible meanings. Uses search links and research tools to comprehend the context and variations of the query.
• Evaluates the relevance and accuracy of the Assistant’s responses. Identify and flag issues such as wrong language, content unavailability, or inappropriate content.
• Validates the accuracy and appropriateness of search results. Ensures results align with user location, query date, and other contextual information.
• Assigns satisfaction ratings based on the established guidelines. Considers factors such as user effort, source quality, and degrees of separation from the query concept.
• Provides detailed feedback and comments on flagged results to aid in search improvement. Highlight common grading mistakes and ensure adherence to guidelines.
• Participates in training and certification processes. Stays updated with guideline changes and incorporate QA feedback into evaluations.

Requirements

Schedule Expectations

Work Hours: This is a full-time remote position requiring 40 hours per week, Monday through Friday. 

Training Phase: During the initial training phase, a set schedule will be required to ensure comprehensive onboarding and integration into the team. 

Flexible Schedule: Upon successful completion of the training phase, a flexible schedule may be offered, allowing for adjustments to better fit personal and professional needs while still meeting project deadlines and team collaboration requirements. 

Availability: Regular availability during standard business hours is essential to maintain communication and collaboration with team members and stakeholders. 

Location: Remote in the following States only: Arizona (AZ) Florida (FL) Georgia (GA) Illinois (IL) Maine (ME) Maryland (MD) Massachusetts (MA) Minnesota (MI) New Mexico (NM) Ohio (OH) Oregon (OR) Pennsylvania (PA) Texas (TX) Virginia (VA) Wisconsin (WI)

Skills:

• Excellent online research skills
• Attention to detail
• Ability to perform thorough research within allocated time
• Ability to follow instructions in English and comply with project conventions and rules
• Excellent Reading Comprehension Skills
• Understanding of User Intent
• Tech Savvy
• Must sign a Non-Disclosure Agreement to protect client confidentiality 
• Must pass training and a required quality test before starting work 
• Must have work authorization in the US
• Reliable computer system and internet connection

Competencies

• Fully Proficient in English (US): Linguistic competency in target language equal to ILR Level 5 or CEF C2
• Preferred Areas of Education and or Experience and Focus, including but not limited to: Localization, Linguistics, Computer Science 
• A degree is not necessary but preferred. Students are welcome to apply. 
• Preferred previous experience: in Search Relevance tasks, with e-commerce searches/websites

Additional Job Details: