Log in Sign up free
Apply now

First seen by our source: 19 days ago

AI Evaluator - Software Expert

@ Mercor

View all jobs Website

Toronto, Ontario

$80–$120/hr5+ years experience
Apply now
SIGNALS

Overview

Mercor is hiring a remote contract AI Evaluator for software, AI, IT and data work at $80 to $120 per hour. The role evaluates AI-generated artifacts against domain-specific quality rubrics, identifies factual and presentation errors in documents, spreadsheets and slide decks, and gives structured feedback to improve model outputs. Candidates need 5+ years of professional experience, English fluency and strong Microsoft Office and Google Workspace skills.

Pay:

$80–$120 an hour

Responsibilities:

  • Evaluate AI-generated artifacts against domain-specific quality rubrics
  • Identify factual, aesthetic and presentation errors in documents, spreadsheets and slide decks
  • Provide clear, structured written feedback to improve AI model outputs
  • Apply subject-matter expertise to grade outputs for accuracy and rigor

Requirements summary:

  • 5+ years of relevant professional experience in software, AI, IT or data
  • Native or professional fluency in English
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides
  • Advanced degree (Master's or higher) preferred

Tools & skills

Microsoft OfficeGoogle WorkspaceGoogle Slides
Source and dates

Source type not verified · manatal

Employer posting date
Not provided
First seen by our source
2026-10-18
Source record updated
2026-10-18

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
Experience5+ years
Travelair: none · ground: none
Work settingHome
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationMaster’s degree (preferred)

Summary and details written by AI from the posting; the employer’s posting is the authority.

Apply now

Mercor

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

We connect human expertise with leading AI labs and enterprises to train frontier models.

Full company description

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

LinkedIn followers
654,507
People associated on LinkedIn
5,250
Reported office locations
  • San Francisco, California 94105, US
Business categories
  • Employment
  • Software
  • Recruiting
  • Data Collection and Labeling
  • Artificial Intelligence (AI)
  • Machine Learning
Other recorded names
  • Mercor
Profile identifies a recruitment agency
Yes
Reported total investment
483,600,000

Currency and observation date were not supplied; this is not a current valuation or a funding round.

View all jobs Website

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

FieldValue
IndustrySoftware Development
Company size51-200 employees
HeadquartersSan Francisco, California
Organization typePrivately Held
Year founded2023
Open jobs on Jobsy1,626
LinkedInView page
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar jobs

  • AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOEMercor needs 5+ years of professional experience in software, AI, IT or data, English fluency and high proficiency in Microsoft Office and Google Workspace, especially Slides. A master's degree is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOECandidates need 5+ years of professional experience in software, AI, IT or data, fluent English, and strong skills in Microsoft Office and Google Workspace, especially Slides. A master's degree or higher is preferred.

    Microsoft Office, Google Workspace, Google Slides

    AI Evaluator - Software Expert

    Toronto, ON
    $80–$120/hr

    Mercor

    5+ YOECandidates need 5+ years of professional experience in software, AI, IT or data, fluent English, and strong skills in Microsoft Office and Google Workspace, especially Slides. A master's degree or higher is preferred.

    Microsoft Office, Google Workspace, Google Slides

  • Electrical Design Engineer - ONT-1068

    Toronto, ON
    Full Time

    PBX Engineering Ltd.

    5+ YOEProject Management experience managing small to medium size projects; Travel to site locations as required; Core Qualifications

    Project management, Documentation, Inspection, Quality assurance procedures, Quality control, Attend meetings

  • Operations Analyst (Toronto-based) – Remote

    Toronto, ON

    Agoda

    2+ YOEWe innovate through a culture of experimentation and ownership, enabling our customers to experience the world; Minimum 2 years experience working in a business analysis, data analysis, reporting or data engineering;…

    Data engineering, Data models, Reporting, Forecasting, GitHub, Negotiate with stakeholders

  • Veterinary Reception, Animal Care Attendant, Secord Animal Hospital

    Toronto, ON
    $19–$25/hrFull Time

    Joffe Veterinary Medicine Professional Corporation

    Compensation: $19.00 to $25.00 per hour, depending on experience and skills; Exceptional customer service skills with a natural ability to show empathy, comfort, and patience under pressure; Outstanding multitasking…

  • Program Coordinator, R.I.T.E.S. Collaborative Program

    Toronto, ON
    $66k–$79k/yrHybridFull Time

    Central Toronto Youth Services

    3+ YOEIdentification as a member of the Black/African Diasporic community is required for this position; Conduct outreach activities, client intakes, brief service assessments, and develop client service plans and discharge…

    Case management, Mental health, Counselling, Systems theory, Crisis intervention, Cognitive behavioural therapy

  • Relief Cook

    Toronto, ON
    $28.85/hrOn-sitePart Time, Contract

    Native Men's Residence

    Other related duties as identified and required; SKILLS REQUIRED:; Knowledge of dietary guidelines; respecting certain diets; and allergies

    Sanitation, Food preparation, Allergies, Heavy lifting, Cooking, Vulnerable sector check

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.