S22 · stakeholder simulation
Four interviewers, one must-have, no consensus
People, data and outputs in this scenario are simulated. Each stage is recorded when you commit; the reveal comes after.
- 4stages
- 35 minabout
- 0stages committed
The brief
You chair a simulated hiring committee for a Senior Applied AI Engineer. Four interviewers rated one candidate (synthetic) on four competencies, 1 = no evidence, 2 = partial, 3 = meets the bar, 4 = exceeds. The role bar, agreed before the loop: mean of at least 3.0 overall, and evaluation design is a must-have at a mean of at least 3.0.
Interviewers' notes (simulated):
- Staff data scientist (rated 4 on evaluation): candidate explained confidence intervals and paired comparison of two models fluently.
- ML engineering lead (rated 2): asked to design an evaluation for a retrieval assistant; the candidate proposed judging 20 outputs by eye and did not mention a held-out set or unanswerable questions.
- Applied-AI lead (rated 2): same design question as the ML engineering lead, similar answer.
- Hiring manager (rated 3): asked about monitoring; the candidate was reasonable but general.
Stage 1 of 4
| Interviewer | Evaluation design | System design | Coding and data | Communication |
|---|---|---|---|---|
| Hiring manager | 3 | 3 | 3 | 4 |
| Staff data scientist | 4 | 3 | 2 | 3 |
| ML engineering lead | 2 | 3 | 3 | 3 |
| Applied-AI lead | 2 | 4 | 3 | 3 |
What does the table show against the bar?