Apply now

First seen by our source: 21 days ago

Business Operations Expert - Evaluator

@ Mercor

Toronto, Ontario

$70–$100/hr5+ years experience
Apply now
SIGNALS

Overview

Mercor is hiring a Business Domain Expert to evaluate AI model outputs in admin, marketing, HR and accounting. The contract involves solving one domain task, ranking five model outputs with scored, evidence-based rationales, and giving structured feedback on the study design. Pay is $70 to $100 per hour, fully remote, with a short turnaround window.

Pay:

$70–$100 an hour

Responsibilities:

  • Solve one domain-specific task from source files
  • Rank five model outputs 1 to 5 with no ties
  • Score each output 0 to 100 with cited rationales
  • Provide structured feedback on task and study design

Requirements summary:

  • 5+ years hands-on experience in admin, marketing, HR or accounting
  • Currently or recently practicing professionally
  • Write clear, evidence-grounded rationales
  • Reliable within short turnaround window

Tools & skills

Source and dates

Source type not verified · manatal

Employer posting date
Not provided
First seen by our source
2026-10-17
Source record updated
2026-10-17

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
Experience5+ years
Travelair: none · ground: none
Work settingHome
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish

Summary and details written by AI from the posting; the employer’s posting is the authority.

Mercor

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

We connect human expertise with leading AI labs and enterprises to train frontier models.

Full company description

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

LinkedIn followers
654,507
People associated on LinkedIn
5,250
Reported office locations
  • San Francisco, California 94105, US
Business categories
  • Employment
  • Software
  • Recruiting
  • Data Collection and Labeling
  • Artificial Intelligence (AI)
  • Machine Learning
Other recorded names
  • Mercor
Profile identifies a recruitment agency
Yes
Reported total investment
483,600,000

Currency and observation date were not supplied; this is not a current valuation or a funding round.

Mercor is defining the future of work. We connect human expertise with leading AI labs and enterprises to train frontier models.

FieldValue
IndustrySoftware Development
Company size51-200 employees
HeadquartersSan Francisco, California
Organization typePrivately Held
Year founded2023
Open jobs on Jobsy1,626
LinkedInView page
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $70–$100/hour
Location: Remote

Role Responsibilities

  • Solve one realistic, domain-specific task using the provided source files.
  • Review five model-generated outputs for the task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
  • Provide structured feedback on the task and study design.
  • Work independently to meet deadlines within a short turnaround window.
  • Use professional judgment as no rubric or golden answer is provided. LLMs or AI assistants are prohibited at every stage.

Qualifications

Must-Have

  • 5+ years of hands-on professional experience in Admin, Marketing, Human Resources, or Accounting.
  • Currently or recently practicing to judge work as a working professional would.
  • Ability to write clear, specific, evidence-grounded rationales for judgments.
  • Reliable within a short turnaround window.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar jobs

  • Business Operations Expert - Evaluator

    Toronto, ON
    $60–$80/hr

    Mercor

    5+ YOECandidates need 5+ years of hands-on experience in admin, marketing, HR or accounting, and must be working or recently working in that field. They need to write clear, evidence-based rationales and deliver reliably within a short turnaround window.

    Research, Work independently

  • Critical Environment Electrical Engineering

    Toronto, ON
    $86k–$169k/yrOn-siteFull Time

    Microsoft: Every company has a mission.

    2+ YOECandidates need a bachelor's or master's degree in electrical or computer engineering plus relevant engineering experience, and must be registered as a P.Eng. in Ontario. Critical environment and electrical infrastructure experience is preferred.

    Blueprints, Building management systems, Switchgear, UPS systems, Standby diesel generators

    Senior Critical Environment Mechanical Engineer

    Toronto, ON
    $114k–$204k/yrOn-siteFull Time

    Microsoft: Every company has a mission.

    7+ YOEMicrosoft requires 7+ years of related engineering experience, or a relevant degree plus 3 to 4+ years of experience, and a P. Eng. registration in Ontario. Candidates must be able to obtain Reliability Status screening and meet Microsoft Cloud background checks.

    CAD modeling tools, Predictive modeling software

  • Receptionist/Administrative Support

    Toronto, ON
    $20–$22/hrContract, Temporary

    adecco

    1+ YOECandidates need 1 to 3 years of reception, front desk or office administration experience. They should communicate well in writing and speaking, be organized, service-oriented, and comfortable with Microsoft Word, Excel, Outlook and Teams.

    Microsoft Word, Microsoft Excel, Microsoft Outlook, Microsoft Teams, audiovisual equipment

    Executive Assistant

    Toronto, ON
    $35–$40/hrContract, Temporary

    adecco

    5+ YOECandidates need 5+ years of directly related executive assistant experience, preferably in finance. They must be advanced in Microsoft Word, PowerPoint, Excel and Outlook, and have Concur experience (Coupa is an asset). Strong written and verbal communication, discretion and the ability to switch priorities quickly are required.

    Concur, Coupa, Microsoft Word, Microsoft PowerPoint, Microsoft Excel, Microsoft Outlook

    Medical & Legal Customer Service Representative

    Toronto, ON
    $28/hrContract, Temporary

    adecco

    Candidates need a high school diploma and bilingual English and French skills, both verbal and written. Experience in customer service, legal, healthcare, or insurance work is preferred, along with strong attention to detail and comfort working remotely on their own device.

    Microsoft Office, Outlook, Excel

  • Physician Reviewer (MD/DO) - Medical AI Evaluation

    Toronto, ON +4
    RemotePart Time

    Mindrift: Mindrift (mindrift.ai) is the expert-sourcing platform built by Toloka, a Nebius Group (Nasdaq: NBIS) company and a global leader in data services…

    Mindrift needs candidates with an MD or DO, an active unrestricted US medical license, and board certification or completed residency. Candidates need broad multi-system clinical experience, strong reasoning, and C1-level written English.

  • Senior GES Payments Specialist - 1 year contract

    Toronto, ON
    Full Time

    Royal Bank of Canada: Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance.

    Stock listing: TSX:RY · NYSE:RY · Source checked: 2026-11-02

    2+ YOECandidates need a bachelor's degree and 2 to 5 years of financial industry or payments processing experience, ideally with sanctions work. They must know SWIFT and ACH transactions and US, EU, UK and Canadian sanctions rules, and work well under high pressure. ACAMS certification is an asset.

    SWIFT, ACH

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.