User Experience Rater (Remote)_

United States

Full-time

Remote

$15/hr - $15/hr

New Grad, Entry Level

Outlier AI is dedicated to enhancing AI intelligence and safety by partnering with experts to provide high-quality data for large language models. The User Experience Rater will evaluate AI outputs, produce natural data, and contribute expertise to refine cutting-edge AI systems.

Apply Now

Responsibilities

Adopt a "user mindset" to produce natural data to meet the realistic needs you have or would use AI for
Use the tool of rubrics to address user needs in a structured way
Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models
Contribute across projects depending on your specific skillset and experience

Qualification

Required

Education Bachelor's degree or higher (or currently enrolled)
Analytical and Problem-Solving Skills Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning
Strong Writing Clear, concise, and engaging writing to explain decisions or critique responses
Attention to Detail Commitment to accuracy and ability to assess technical aspects of model outputs

Preferred

Experience in fields like literature, creative writing, history, philosophy, theology, etc
Prior writing or editorial experience (content strategist, technical writer, editor, etc.)
Interest or background in AI, machine learning, or creative tech tools