Does the published evaluation report accuracy separately for each task the system will be used for?
Printable clinical checklist
Complete Section D only for systems already in use.
Phase 1Before use: three sources of assurance
Section A: Clinical evidence
Source: the published evaluation or product documentation.Does it work safely for the oncology task and the patients we intend to use it for?Does it report performance on real clinical records, or only on standardised clinical vignettes?
Does it report a hallucination rate?
Does it grade potentially harmful outputs on a defined harm classification scale, rather than describing them narratively?
Does it report performance broken down by patient subgroup, at minimum age and sex, and declare any missing demographic data?
Does it identify exactly which system was tested — model name, version, date of access, and how it was prompted?
Does it report whether repeated identical queries produce consistent answers?
Does it assess the risk that the system had already seen the evaluation cases during training?
Does it include validation at an institution other than the one that developed the system?
Does the evidence go beyond retrospective cases into a controlled prospective setting?
Is the supporting evidence drawn from oncology, rather than from other specialties alone?
Section B: Institutional readiness
Source: local policy and governance.Can we use it responsibly and safely in our own department or institution?Does this system transmit patient data outside the institution, and are the categories of data it requires permitted under our institutional rules?
Is this system covered by a documented institutional governance decision, rather than being used informally?
Is it documented whether this system is locally hosted or cloud-based, and is that choice recorded as a governance decision with its reasoning?
Is the regulatory status of this system in our jurisdiction documented ?
Does the documentation for this system state that it functions as decision support, with final responsibility for the clinical decision remaining with the treating clinician?
Is there a documented arrangement for informing patients when this system contributes to decisions about their care?
Is there a documented fallback procedure for when this system is unavailable or produces unreliable output?
Section C: Vendor assurance
Source: supplier documentation or contract.Will the deployed version be supported and monitored responsibly?Does the vendor provide evidence of a post-deployment safety monitoring arrangement, including structured feedback collection from clinical users?
Does the vendor provide a written division of responsibility between supplier and institution for continuous quality and safety monitoring?
Does the vendor provide a reporting channel through which a clinician can report an error or unexpected output to both the institution and the developer?
Does the vendor provide evidence that the validation shown applies to the version we will actually be running?
Deployment gate
Section A: Clinical evidence
- Yes
- No
- Not assessable
Section B: Institutional readiness
- Yes
- No
- Not assessable
Section C: Vendor assurance
- Yes
- No
- Not assessable
If all critical safeguards are adequately addressed, the system can proceed to controlled clinical deployment. If not, resolve the gap, restrict the intended use, or do not deploy.
Phase 2Once in use: monitor and evaluate
Section D: Monitor and evaluate
- 1. Monitor routinely
- 2. Trigger a review
- 3. Re-evaluate locally
- 4. Make a decision
1. Monitor routinely
Performance drift, clinician over-reliance, unexpected or unsafe outputs
Is there documented monitoring in place to detect performance falling off as guidelines change and new drugs are approved?
Is there evidence that over-reliance (i.e. clinicians accept incorrect outputs without independent review) is being watched for?
2. Trigger a review
Scheduled review date; new guideline, drug or standard of care; model, API or interface update
Is there a documented date, or trigger, at which this system will be formally re-evaluated?
Are there documented rules for what happens when the vendor releases a new version, and a named person managing that?
3. Re-evaluate locally
Clinical accuracy and safety, patient outcomes, technical stability
Is there a documented arrangement linking AI-supported decisions to what actually happened to those patients?
Is there evidence that output remains stable across our hardware, software versions and interface updates?
4. Make a decision
Continue / Modify and revalidate / Pause / Retire