DevFlow Conf 2026
Olu Adeyemi

Olu Adeyemi

Engineering Director, Kestrel Health

Engineering Director, Kestrel Health

Ships machine learning into clinical workflows, where being wrong is expensive.

Sessions

Evaluating Model Output When There Is No Right Answer

15 May 2026, 10:15 – 10:45 · Room 2B · AI Engineering · Talk (30 min)

In clinical summarisation there is no gold answer to score against, and accuracy is the wrong question anyway. How Kestrel Health built an evaluation set clinicians agreed with,… Show more

In clinical summarisation there is no gold answer to score against, and accuracy is the wrong question anyway. How Kestrel Health built an evaluation set clinicians agreed with, what inter-rater disagreement told us about the task, and the failure modes that only ever showed up in review.

Olu Adeyemi — Engineering Director, Kestrel Health

← Back to speakers