Log in Sign up free
Apply now

Posted 3 months ago

Copy of LLM Model Response Evaluation

@ Lifted, an Upwork Company™

View all jobs Website

Ottawa, Ontario

RemoteContract3+ years experience
Apply now
SIGNALS

Overview

Lifted, an Upwork Company, is hiring contract evaluators for a global AI company to rate model-generated content against quality rubrics. The work covers UI widgets, infographics, images, and side-by-side comparisons across text, images, audio, video and PDFs. Work is remote, with a variable workload and no guaranteed hours.

Responsibilities:

  • Evaluate AI-generated content against quality rubrics
  • Assess factuality, consistency and aesthetics
  • Review text, images, audio, video, HTML and PDFs
  • Independently research unfamiliar topics using trusted sources

Requirements summary:

  • 3+ years of LLM or GenAI data evaluation experience
  • Bachelor's degree required
  • Ability to research and make well-supported judgments
  • Comfortable evaluating multiple modalities

Tools & skills

HTMLResearch
Source and dates

Employer career site / ATS feed · smartrecruiters

Employer posting date
2026-08-06
First seen by our source
2026-10-08
Source record updated
2026-10-09

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SeniorityMid level
DepartmentData & analytics
Experience3+ years
Travelair: none · ground: none
Work settingHome
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationBachelor’s degree (required)

Summary and details written by AI from the posting; the employer’s posting is the authority.

Apply now

Lifted, an Upwork Company™

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

One solution built for enterprise companies to source, contract, manage, and pay any type of contingent talent.

Full company description

Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.

LinkedIn followers
6,800
People associated on LinkedIn
282
Business categories
  • Information Technology
  • Internet
Other recorded names
  • Lifted
  • Lifted, an Upwork Company™
  • Lifted, an Upwork Company
Profile identifies a recruitment agency
No
Reported total investment
0

Currency and observation date were not supplied; this is not a current valuation or a funding round.

View all jobs Website

Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.

FieldValue
IndustryTechnology, Information and Internet
Company size201-500 employees
Organization typePublic Company
Year founded2025
Open jobs on Jobsy31
LinkedInView page
Job description

Company Description

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities

Additional Information

Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly

Similar jobs

  • Coffee Clerk Part Time Day

    Ottawa, ON
    Part Time

    Loblaw

    Candidates need a team spirit, attention to detail, courtesy with customers, and willingness to learn. They must be able to work varied shifts including days, evenings and weekends, and lift up to 50 lb while moving for a full shift.

    POS

  • Sales Development Intern - 12 Months Term

    Ottawa, ON
    On-siteFull Time

    Convoy Supply

    Convoy Supply asks for interest in sales and building materials, clear communication, initiative and strong organization. Basic computer skills and teamwork are needed; CRM or ERP experience, business studies and prior sales experience are assets.

    CRM, ERP

  • General Manager - Off Campus

    Ottawa, ON

    Campus Living Centres

    5+ YOECandidates need a recognized college diploma or university degree and at least 5 years of industry or management experience. Strong written and verbal communication, budgeting, staff management and the ability to handle several projects at once are essential.

    Yardi

  • Coffee Clerk Part Time Day

    Ottawa, ON
    Part Time

    Loblaws Inc.

    Candidates need no prior experience, since training is provided. They must be flexible across departments and hours including days, evenings and weekends, able to lift up to 50 lbs, and stay mobile for an entire shift.

    Coffee Clerk Part Time Day Greenlight Requisition

    Ottawa, ON
    Part Time

    Loblaws Inc.

    Candidates need a team-oriented, detail-minded attitude and the ability to work independently in a fast-paced store. They must be flexible across departments and hours, able to lift up to 50 lbs and stay mobile for a full shift.

    Cashier Part Time Day Greenlight Requisition

    Ottawa, ON
    Part Time

    Loblaws Inc.

    Candidates need good communication skills, a team-player attitude, and the ability to work at a fast pace. They must be able to lift 25 lbs and stand for entire shifts, and be flexible about working days, evenings and weekends.

  • Sales Associate - PT

    Ottawa, ON
    Part Time

    Michael Kors (Canada) Holdings LTD

    2+ YOEMichael Kors needs candidates with 2+ years of relevant retail experience, a self-starting, energetic attitude, and a passion for fashion and customer service. Comfort with technology and an entrepreneurial spirit are also sought.

  • Assistant Team Leader

    Ottawa, ON
    Full Time, Part Time

    Dollarama: Puis, l’entreprise a connu une croissance rapide au cours des vingt années suivantes et est devenue une référence pour les ménages canadiens et une…

    1+ YOE1+ MgmtCandidates need about one year of retail experience and one year in a supervisory role. Dollarama asks for flexible availability, strong communication and leadership skills, and the ability to multitask in a fast-paced store.

    Mobile application

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.