User Experience Rater (Remote)

United States

Full-time

Remote

$15/hr - $15/hr

New Grad, Entry Level

Outlier AI is committed to improving the intelligence and safety of AI models by partnering experts with top AI labs. They are seeking a User Experience Rater to contribute expertise toward training and refining AI systems by evaluating AI outputs and providing structured feedback.

Apply Now

Responsibilities

Adopt a "user mindset" to produce natural data to meet the realistic needs you have or would use AI for
Use the tool of rubrics to address user needs in a structured way
Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models
Contribute across projects depending on your specific skillset and experience

Qualification

Required

Fluent in English
Bachelor's degree or higher (or currently enrolled)
Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning
Clear, concise, and engaging writing to explain decisions or critique responses
Commitment to accuracy and ability to assess technical aspects of model outputs

Preferred

Experience in fields like literature, creative writing, history, philosophy, theology, etc
Prior writing or editorial experience (content strategist, technical writer, editor, etc.)
Interest or background in AI, machine learning, or creative tech tools