Approach
Epidemiology, applied to AI.
The questions we ask of a screening test, asked of your new tool.
Seven questions, in order.
Population
Whose work, and which items?
Denominator
Out of how many?
Provenance
Where did each number come from?
Baseline
Compared with what?
Pass line
Agreed before anyone sees results.
Staged rollout
Side by side, then limited, then wider.
Decision
Continue, revise, restrict or stop.
Four possible decisions.
Continue
Criteria met. Keep monitoring.
Revise
A fixable miss. Test again.
Restrict
Works for some cases. Narrow it.
Stop
Failed or too risky. Use the fallback.