Log in Sign up free
Apply now

First seen by our source: 20 days ago

AI Evaluator - Software Expert

@ Mercor

View all jobs Website

Toronto, Ontario

$80–$120/hr5+ years experience
Apply now
SIGNALS

Overview

Mercor is hiring a remote contract AI Evaluator for software, AI, IT and data work at $80 to $120 per hour. The role evaluates AI-generated artifacts against domain-specific quality rubrics, identifies factual and presentation errors in documents, spreadsheets and slide decks, and gives structured feedback to improve model outputs. Candidates need 5+ years of professional experience, English fluency and strong Microsoft Office and Google Workspace skills.

Pay:

$80–$120 an hour

Responsibilities:

  • Evaluate AI-generated artifacts against domain-specific quality rubrics
  • Identify factual, aesthetic and presentation errors in documents, spreadsheets and slide decks
  • Provide clear, structured written feedback to improve AI model outputs
  • Apply subject-matter expertise to grade outputs for accuracy and rigor

Requirements summary:

  • 5+ years of relevant professional experience in software, AI, IT or data
  • Native or professional fluency in English
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides
  • Advanced degree (Master's or higher) preferred

Tools & skills

Microsoft OfficeGoogle WorkspaceGoogle Slides
Source and dates

Source type not verified · manatal

Employer posting date
Not provided
First seen by our source
2026-10-18
Source record updated
2026-10-18

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
Experience5+ years
Travelair: none · ground: none
Work settingHome
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationMaster’s degree (preferred)

Summary and details written by AI from the posting; the employer’s posting is the authority.

Apply now

Mercor

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

We connect human expertise with leading AI labs and enterprises to train frontier models.

Full company description

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

LinkedIn followers
654,507
People associated on LinkedIn
5,250
Reported office locations
  • San Francisco, California 94105, US
Business categories
  • Employment
  • Software
  • Recruiting
  • Data Collection and Labeling
  • Artificial Intelligence (AI)
  • Machine Learning
Other recorded names
  • Mercor
Profile identifies a recruitment agency
Yes
Reported total investment
483,600,000

Currency and observation date were not supplied; this is not a current valuation or a funding round.

View all jobs Website

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

FieldValue
IndustrySoftware Development
Company size51-200 employees
HeadquartersSan Francisco, California
Organization typePrivately Held
Year founded2023
Open jobs on Jobsy1,626
LinkedInView page
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar jobs

  • AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOEMercor needs 5+ years of professional experience in software, AI, IT or data, English fluency and high proficiency in Microsoft Office and Google Workspace, especially Slides. A master's degree is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOECandidates need 5+ years of professional experience in software, AI, IT or data, fluent English, and strong skills in Microsoft Office and Google Workspace, especially Slides. A master's degree or higher is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOECandidates need 5+ years of professional experience in software, AI, IT or data, fluent English, and strong skills in Microsoft Office and Google Workspace, especially Slides. A master's degree or higher is preferred.

    Microsoft Office, Google Workspace, Google Slides

  • Coordinator, Production & Content Media Operation

    Toronto, ON
    $55k–$60k/yrOn-siteFull Time

    CAN - Warner Music Canada Co.

    You will be part of a team of professionals but will have responsibility for your own projects that require the ability to handle multiple tasks and manage various priorities; • 2+ years' experience in an operations…

  • Co-ordinator, Growth Services

    Toronto, ON +4
    $66k–$70k/yrFull Time, Contract

    Co-operative Housing Federation of Canada / Fédération de l'habitation coopérative du Canada

    There is significant unmet demand for affordable and co-operative housing, and we want more people to experience the security, vibrancy and resiliency of co-operative living; An equivalent combination of training,…

  • Financial Controller

    Toronto, ON
    $120k–$145k/yrHybridFull Time

    Institute for Work and Health

    The Financial Controller is required to have solid communication, technology, analytical and management skills; They must demonstrate knowledge of Accounting Standards for Not-For-Profit Organizations as well as…

  • Activities of Daily Living Worker

    Toronto, ON
    $29.40/hrOn-siteFull Time

    Fred Victor

    Assisting with any pest control/eradication efforts, as required; Post-Secondary Education in Social Services or related field and/or lived experience or equivalency; Strong understanding of systems that cause and…

  • Manager, Leadership Giving Ontario

    Toronto, ON +1
    $67k–$77k/yrHybridFull Time

    Canadian Cancer Society

    Helps build the Ontario Major Gifts program by implementing the processes, systems, tools and communications required to effectively identify, qualify, cultivate, solicit, and steward…; Bachelor’s Degree in…

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.