Log in Sign up free
Apply now

First seen by our source: 20 days ago

AI Evaluator - Software Expert

@ Mercor

View all jobs Website

Toronto, Ontario

$80–$120/hr5+ years experience
Apply now
SIGNALS

Overview

Mercor is hiring a remote contract AI Evaluator with software, AI, IT or data expertise at $80 to $120 per hour. The role evaluates AI-generated artifacts against domain-specific quality rubrics, identifying factual, aesthetic and presentation errors and giving structured written feedback. The posting requires 5+ years of professional experience, English fluency and proficiency in Microsoft Office and Google Workspace, especially Slides.

Pay:

$80–$120 an hour

Responsibilities:

  • Evaluate AI-generated artifacts against domain-specific quality rubrics
  • Identify factual, aesthetic and presentation errors in outputs
  • Provide clear, structured written feedback to improve quality
  • Work independently and asynchronously to meet deadlines

Requirements summary:

  • 5+ years of professional experience in Software, AI, IT or data
  • Native or professional fluency in English
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides
  • Advanced degree (Master's or higher) preferred

Tools & skills

Microsoft OfficeGoogle WorkspaceGoogle Slides
Source and dates

Source type not verified · manatal

Employer posting date
Not provided
First seen by our source
2026-10-17
Source record updated
2026-10-17

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
DepartmentSoftware development
Experience5+ years
Travelair: none · ground: none
Work settingHome
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationMaster’s degree (preferred)

Summary and details written by AI from the posting; the employer’s posting is the authority.

Apply now

Mercor

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

We connect human expertise with leading AI labs and enterprises to train frontier models.

Full company description

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

LinkedIn followers
654,507
People associated on LinkedIn
5,250
Reported office locations
  • San Francisco, California 94105, US
Business categories
  • Employment
  • Software
  • Recruiting
  • Data Collection and Labeling
  • Artificial Intelligence (AI)
  • Machine Learning
Other recorded names
  • Mercor
Profile identifies a recruitment agency
Yes
Reported total investment
483,600,000

Currency and observation date were not supplied; this is not a current valuation or a funding round.

View all jobs Website

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

FieldValue
IndustrySoftware Development
Company size51-200 employees
HeadquartersSan Francisco, California
Organization typePrivately Held
Year founded2023
Open jobs on Jobsy1,626
LinkedInView page
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in outputs.
  • Provide clear, structured written feedback to improve quality.
  • Work independently and asynchronously to meet deadlines.
  • Utilize expertise in Microsoft Office and Google Workspace, especially Slides.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar jobs

  • AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOEMercor needs 5+ years of professional experience in software, AI, IT or data, English fluency and high proficiency in Microsoft Office and Google Workspace, especially Slides. A master's degree is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOEMercor needs 5+ years of professional experience in software, AI, IT or data, English fluency and high proficiency in Microsoft Office and Google Workspace, especially Slides. A master's degree is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOECandidates need 5+ years of professional experience in software, AI, IT or data, fluent English, and strong skills in Microsoft Office and Google Workspace, especially Slides. A master's degree or higher is preferred.

    Microsoft Office, Google Workspace, Google Slides

  • Executive Director

    Toronto, ON
    $90k–$140k/yrOn-siteFull Time

    BGC Dovercourt

    Ensure all legal obligations of the organization are met and that legal opinion is sought where required; The Executive Director will be thoroughly committed to the BGC Dovercourt’s mission, vision and strategic plan;…

  • Director of Organizing + Membership

    Toronto, ON
    $88k/yrFull Time, Contract

    Migrant Workers Alliance for Change

    Our work has grown significantly over the years, and we must now re-design our methods so that we can make the next leap in worker power; If you have experience building worker power from the base up, at scale, and…

    Operations Director

    Toronto, ON
    $88k/yrHybridFull Time

    Migrant Workers Alliance for Change

    Support grant administration, funding compliance, expense tracking, and financial reporting requirements; Create systems that reduce reliance on informal knowledge, individual memory, and ad hoc coordination; Ensure…

  • Executive Director, EYET Family Resources

    Toronto, ON
    $153k–$172k/yrOn-siteFull Time

    crawfordconnect

    A seasoned leader (ED or senior leadership experience) in the non-profit sector, with a minimum 5 years of prior executive/senior administrative management experience in a non-profit,…; Expertise in the fields of early…

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.