hirq
← All jobs

Lifted, an Upwork Company™

LLM Model Response Evaluation

Maryland City, MD, US · Remote · Contract

Apply well, not just fast

Create a free account and upload your resume to get a match score, keyword gaps, a tailored resume, a cover letter and interview prep for this job.

About the role

LLMsHTMLGenerative AIUI Design
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria. - Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities. - The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities. - The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more. - Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions. - Each task will include detailed project guidelines within the evaluation platform. - 3+ years of hands-on experience in LLM / GenAI data evaluation. - Bachelor's Degree required  - Ability to research unfamiliar topics using trusted sources and make well-supported judgments. - Comfortable evaluating content across multiple modalities  Flexible and remote work Variable workload: Accept or decline tasks based on your availability No guaranteed hours: Workload may vary weekly