Psychometrician

Consider an opportunity to join our talented team

The Medical Council of Canada (MCC) was recognized as a National Capital Region Top Employer for ten consecutive years!

Want to contribute to the health and wellbeing of Canadians?At the MCC, you’ll be part of a dynamic team that ensures that physicians have the competencies to support safe, accessible health care in Canada.

You’ll be immersed in an exceptional work environment that fosters professional development and work-life balance.

Apply for one of our rewarding positions today!

Psychometrician

Full time permanent

Ottawa, Ontario, Canada

Hybrid role

1 vacancy

Are you passionate about turning data into insights that matter? Do you love the challenge of ensuring assessments are fair, valid, and reliable? If so, we want to hear from you!

The Medical Council of Canada (MCC) is looking for a curious, detail-driven Psychometrician to join our dynamic team of statistical analysts and psychometricians. Reporting to the Manager, Psychometrics and Data Science, you’ll be at the heart of our Program of Assessments, playing a key role in both daily operations and shaping the future of medical assessment in Canada.

From leading standard-setting exercises to conducting in-depth psychometric analyses, your work will help ensure the MCC’s assessments remain world-class. If collaboration, innovation, and advancing best practices in medical assessment excite you—this could be your next great opportunity.

What you’ll do

• Enhance operational processes by automating, streamlining, and improving exam-related statistical and psychometric procedures.
• Lead assessment design, data analysis, and psychometric evaluations to uphold exam validity and reliability.
• Conduct item analyses, equating, and test form assembly to ensure consistency and fairness across exam administrations.
• Lead and facilitate standard-setting exercises for MCC examination programs.
• Conducts targeted projects and research to provide a continued evidence base in support of MCC exams, programs and services.
• Designs and executes research studies that support MCC’s strategy for medical assessment innovation.
• Provide expert consultation on psychometric challenges related to exam programs, research projects, and operational processes.

What you need to succeed

Experience

• 1-3 years of experience (3-5 years an Asset), preferably from a testing organization.

Technical Skills

• Advanced knowledge of psychometrics and statistics, including item response theory, Rasch models, reliability and equating.
• Strong computer programming skills e.g., Python, SAS, R, and IRT software.
• Practical experience in solving operational testing program issues.
• Knowledge and/or experience with program evaluation (Asset)
• Knowledge and/or experience with performance assessments in medicine (e.g., OSCEs) (Asset).
• Knowledge and/or experience in test security, natural language processing, automated item
• generation, data analytics and machine learning (Asset).

Competencies

• Independently driven in completing their work.
• Strong and innovative problem solver.
• Ability to meet multiple deadlines.
• Ability to work effectively in multidisciplinary teams.
• Ability to explain complex psychometric and statistical concepts to different audiences.

Education

• PHD in Psychometrics, Measurement, Statistics or another quantitative field.

Language

• Superior oral and written skills in English are required, with oral and written skills in French considered an asset

The perks

• A defined benefit pension plan.
• A complete benefit package your first day on the job.
• Three weeks' vacation right off the bat.
• A company paid holiday closure in December - our gift to you!
• A 35-hour work week.
• Compressed schedule program.
• Hybrid Work Environment.
• Free onsite parking - any day, any time.
• Free Yoga, Zumba, Mobility and Strength & Conditioning classes.

Visit our Careers page to discover what sets us apart and how we cultivate an environment where employees thrive.

The MCC is an equal opportunity employer, committed to diversity and inclusion in the workplace at all levels of its organization. Our team fosters belonging by welcoming and valuing people with diverse backgrounds and incorporating their experiences and perspectives into our work.

AI-based tools from third-party platforms may be used to support application screening and candidate matching. Human recruiters review all applications and make final hiring decisions.

Accommodations can be provided at all stages of the hiring process; we ask applicants to make their needs known in advance.

Please note that only those invited for an interview will be contacted.