Appendix A: Criteria to appraise the validity of indicators
The indicator advisory committee advises on the progression of indicators in development using the following criteria to assess validity:
| Domain | Criteria |
|---|---|
|
Importance |
The indicator reflects a specific priority area identified by NHS England or the Department for Health and Social Care. The indicator relates to an area where there is known variation in practice. The indicator will lead to a meaningful improvement in outcomes. The indicator addresses under or over-treatment. |
|
Evidence base |
The indicator is derived from a high-quality evidence base. The indicator aligns with the evidence base. |
|
Specification |
The indicator has defined components necessary to construct the indicator, including numerator, denominator and exclusions. The indicator has a defined system or provider level at which the indicator is intended to be used. The indicator outlines an expected population size and if a minimum number of patients is required, related to its intended use. |
|
Feasibility |
The indicator is repeatable. The indicator is measuring what it is designed to measure. The indicator uses existing data fields or the burden of additional data collection is acceptable. |
|
Acceptability |
The indicator assesses performance that is attributable to or within the control of the audience. The results of the indicator can be used to improve practice. |
|
Risk |
The indicator has an acceptable risk of unintended consequences. |
Modified from MacLean et al (2018) Time Out — Charting a Path for Improving Performance Measurement N Engl J Med 2018 378:1757-1761