First seen by our source: 3 days ago
📣 PhD opportunity in Montréal — Human-Guided Evaluation of Generative AI Systems
@ Université Paris-Saclay
Montréal, Quebec
Overview
Université Paris-Saclay is offering a full-time PhD position in Montréal, starting January 2027, researching human-guided evaluation of generative AI systems. The work combines probabilistic modelling, adaptive testing, simulated users and targeted human feedback to assess reliability and uncertainty of language models. Funding is competitive, a cotutelle with McGill University is possible, and applications are accepted on a rolling basis until the position is filled.
Responsibilities:
- Design evaluation methods for generative AI systems
- Explore probabilistic modelling and adaptive testing
- Run experiments on language models
- Use targeted human feedback to assess reliability
Requirements summary:
- Background in computer science, mathematics, statistics or engineering
- Interest in combining theory with experimentation
Source and dates
Source type not verified · apify-linkedin
- Employer posting date
- Not provided
- First seen by our source
- 2026-11-14
- Source record updated
- 2026-11-14
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Entry level |
| Department | Research & science |
| Hours per week | 40 (estimated) |
| Work setting | Office, Laboratory |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
| Languages | English |
| Education | Doctorate (required) |
| Fields of study | Computer science, Mathematics, Statistics, Engineering |
Summary and details written by AI from the posting; the employer’s posting is the authority.
Université Paris-Saclay
| Field | Value |
|---|---|
| Open jobs on Jobsy | 1 |
📣 PhD opportunity in Montréal — Human-Guided Evaluation of Generative AI Systems
How can we evaluate AI systems in realistic situations—and decide which tests or expert judgments will provide the most valuable evidence about their risks?
Together with Jackie Cheung and our partners at Waterloo, Université Aix-Marseille and Orange, I am seeking a PhD candidate within REGARD project to explore these questions through probabilistic modelling, adaptive testing, simulated users, and targeted human feedback.
The research will connect mathematical foundations with experiments on language models, focusing on reliability, uncertainty, and the efficient use of human expertise.
📍 Montréal, with research activities at ILLS and Mila
📅 Intended start — January 2027
🎓 Possibility of a cotutelle between Université Paris-Saclay and McGill University
đź’° Competitive funding
đź“© Rolling applications until the position is filled
We welcome applicants from computer science, mathematics, statistics, engineering, and related disciplines who enjoy combining theory with experimentation.
Full description and application details
https://pablo-piantanida.org/openings/phd-ai-evaluation/
Please share with students who may be interested!
#PhDPosition #AIEvaluation #GenerativeAI #MachineLearning #NLP #ResponsibleAI
Journal
Only you can see this. Kept on this device, and in your account when you sign in.