Evaluation of design and outputs: outcomes
The team knows how to evaluate bias in the design and outputs, and the evidence is in the profile and the evaluation document.
What clause 9.2.5 asks
The evaluation ends with a team that knows how to judge bias in the design and output, and with a report and profile that show it was done. The document does not say the system is free of bias. It says the method is understood and has been used, and the record shows both.
Why it matters
The distinction between knowing how and having done it is the difference between a capability and an assurance claim. The clause asks for the capability, and the outputs in clause 9.2.3 supply the evidence that it was used. A team that can describe the method but has no evaluation document has the capability only. A team that has a document but cannot explain the method has a result it cannot defend.
What good looks like
At the end of the evaluation, write a short statement of what was evaluated, what was found and what remains unknown. Give it to the risk owner and the accountable owner. Record the method in enough detail that another team could repeat it. Then confirm that the evaluation document and the profile are linked and versioned.
Evidence an assessor asks for
The assessor will ask what remains unknown. An evaluation that reports no uncertainty is usually one that did not look beyond its own test set.
- Evaluation statement What was evaluated, what was found and what remains unknown
- Method record The method in enough detail for another team to repeat it
- Owner briefing The risk and accountable owners' confirmation that they have read the findings
- Version link The evaluation document and profile versions that belong together
Where it commonly fails
- The team claims the system is unbiased
- The method is not recorded well enough to repeat
- The owner has not seen the findings
What to do before publication
Write the unknown list as deliberately as the findings list. It is part of an honest evaluation.
Read across
- 9.1 Purpose
- 9.2.3 Evaluation of design and outputs: outputs
- 9.3.1 Ongoing evaluation: purpose
- 8.5 Outcomes
← 9.2.4.4 End of the evaluation9.3.1 Ongoing evaluation: purpose →