Search Satisfaction Grader

Job Summary:
We seek a detail-oriented and dedicatedSearch Satisfaction Graderto join our Search Evaluation Project. The primary responsibility of this role is to evaluate search results returned by an AI Assistant, ensuring they meet user intent, relevance, and contextual appropriateness according to established guidelines.
The ideal candidate will possess strong analytical skills, excellent reading comprehension skills, a keen eye for detail, and the ability to provide insightful feedback to improve search functionalities.

Project Details:
Start Date:Immediately after completing the qualification process
Duration:Ongoing
Employment Type:W2 Full-time Employee, eligible for benefits
Language:English (US)
Pay Rate:$15/hour

Schedule Expectations
Work Hours:This full-time remote position requires 40 hours per week, Monday through Friday.
Training Phase:During the initial training phase, a set schedule will be required to ensure comprehensive onboarding and integration into the team.
Flexible Schedule:Upon successfully completing the training phase, a flexible schedule may be offered, allowing for adjustments to better fit personal and professional needs while still meeting project deadlines and team collaboration requirements.
Availability:Regular availability during standard business hours is essential to maintain communication and collaboration with team members and stakeholders.
Location: Remote in the following States only: Arizona (AZ) Florida (FL) Georgia (GA) Illinois (IL) Maine (ME) Maryland (MD) Massachusetts (MA) Minnesota (MI) New Mexico (NM) Ohio (OH) Oregon (OR) Pennsylvania (PA) Texas (TX) Virginia (VA) Wisconsin (WI)

By applying, you'll become part of our team, contributing to a range of projects tailored to your skills and availability, particularly highlighting localization and linguistic expertise.
Key Responsibilities:

Understand the Query:Analyze user queries to determine intent and possible meanings. Use web search links and research tools to comprehend the context and variations of the query.
Review and Assess Search Results:Evaluate the relevance and accuracy of the Assistant's responses. Identify and flag issues such as wrong language, content unavailability, or inappropriate content.
Validate Results:Confirm the accuracy and appropriateness of search results. Ensure results align with user location, query date, and other contextual information.
Rate the Results:Assign satisfaction ratings (Highly Satisfying to Not Satisfying) based on the established guidelines. Consider factors such as user effort, source quality, and degrees of separation from the query concept.
Provide Feedback:Offer detailed feedback and comments on flagged results to aid in search improvement. Highlight common grading mistakes and ensure adherence to guidelines.
Continuous Improvement:Participate in training and certification processes. Stay updated with guideline changes and incorporate QA feedback into evaluations.
Requirements:

Fully Proficient in English (US): Linguistic competency in target language equal to ILR Level 5 or CEF C2
Preferred Areas of Education and or Experience and Focus, including but not limited to:Localization, Linguistics, Computer Science
A degree is not necessary but preferred. Students are welcome to apply.
Preferred previous experience:in Search Relevance tasks, with e-commerce searches/websites
Skills:
Excellent online research skills
Attention to detail
Ability to perform thorough research within allocated time
Ability to follow instructions in English and comply with project conventions and rules
Excellent Reading Comprehension Skills
Understanding of User Intent
Tech Savvy
Additional Requirements:

Must sign a Non-Disclosure Agreement to protect client confidentiality
Must pass training and a required quality test before starting work
Must have work authorization in the US
Reliable computer system and internet connection
$15 - $15 an hour
Benefits:
·Accident, Critical Illness, Hospital Indemnity Insurance
·Telemedicine Benefit
·Paid Sick Time
·Paid Holiday – 2 days
·Employee Assistance Program
Following eligibility requirements:
·Medical Insurance,Dental Insurance, Vision Insurance,HSA,Voluntary Life Insurance
·401(k) Retirement Plan
What to Expect
- Collaborate on projects with leading tech companies in the AI industry.
- Learn and develop skills with an experienced team involved in various aspects of AI technology.
- Gain hands-on experience in the world of AI-driven search functionalities and localization.
- Develop quality assurance testing skills that are applicable across multiple industries.

Join our dynamic team and work with cutting-edge AI content, making a real impact in AI models, search evaluation, and localization. Gain valuable experience in the AI industry and contribute to the development and refinement of AI models.