Tools and resources

Appendix K: GRADE profile and economic evidence profile

K1: Worked example of a GRADE profile

Review question: Should duloxetine vs placebo be used for painful diabetic neuropathy?

Quality assessment

No. of patients

Effect

Quality

Importance

No. of studies

Design

Risk of bias

Inconsistency

Indirectness

Imprecision

Other considerations

Duloxetine

Placebo

Relative
(95% CI)

Absolute

Patient-reported 30% pain reduction (follow-up 12 weeks)

21

Randomised trials

No serious risk of bias

Serious2

No serious indirectness

No serious imprecision

None

220/327

111/215

RR 1.33
(0.95 to 1.88)

17 more per 100 (from 3 fewer to 45 more)

Moderate

Critical

Patient-reported 50% pain reduction (follow-up 12 weeks)

43

Randomised trials

No serious risk of bias

Serious4

No serious indirectness

Serious imprecision5

None

485/896

164/443

RR 1.51 (1.17 to 1.94)

19 more per 100 (from 6 more to 35 more)

Moderate

Critical

No. of withdrawals due to adverse effects (follow-up 12 weeks)

43

Randomised trials

No serious risk of bias

No serious inconsistency

No serious indirectness

No serious imprecision

None

113/906

21/448

RR 2.63 (1.68 to 4.12)

8 more per 100 (from 3 more to 15 more)

High

Critical

Dizziness (adverse effects) (follow-up 12 weeks)

36

Randomised trials

No serious risk of bias

No serious inconsistency

No serious indirectness

Serious imprecision5

None

90/674

26/332

RR 1.81 (1.17 to 2.79)

6 more per 100 (from 1 more to 14 more)

Moderate

Critical

Dry mouth (adverse effects) (follow-up 12 weeks)

27

Randomised trials

No serious risk of bias

No serious inconsistency

No serious indirectness

Serious imprecision5

None

37/448

10/224

RR 1.61 (0.82 to 3.20)

3 more per 100 (from 1 fewer to 10 more)

Moderate

Important

GI disturbances (adverse effects) (follow-up 12 weeks)

28

Randomised trials

No serious risk of bias

No serious inconsistency

No serious indirectness

Serious imprecision5

None

28/332

8/217

RR 2.53 (1.13 to 5.67)

6 more per 100 (from 0 more to 17 more)

Moderate

Important

Any adverse effects (non-specified) (follow-up 12 weeks)

19

Randomised trials

No serious risk of bias

No serious inconsistency

No serious indirectness

Very serious imprecision10

None

86/106

78/109

RR 1.13 (0.98 to 1.32)

9 more per 100 (from 1 fewer to 23 more)

Low

Critical

1 Gao et al. (2010); Wernicke et al. (2006).

2 Substantial heterogeneity, random-effect model was used. Potential sources of heterogeneity: i) Gao et al. (2010) – ITT data available, used flexible dose between 30 mg and 120 mg, non-pharmaceutical company funded; ii) Wernicke et al. (2006) – only per-protocol data available, combined two fixed doses (60 mg and 120 mg), pharmaceutical company funded.

3 Gao et al. (2010); Goldstein et al. (2005); Raskin et al. (2005); Wernicke et al. (2006).

4 Substantial heterogeneity, random-effect model was used. Potential sources of heterogeneity: i) Gao et al. (2010) – used flexible dose between 30 mg and 120 mg, non-pharmaceutical company funded; ii) Goldstein et al. (2005), Raskin et al. (2005) and Wernicke et al. (2006) – combined different fixed doses (20 mg, 60 mg and 120 mg), pharmaceutical company funded.

5 Confidence interval crossed one end of default MID.

6Gao et al. (2010); Goldstein et al. (2005); Wernicke et al. (2006).

7 Gao et al. (2010); Goldstein et al. (2005).

8 Gao et al. (2010); Wernicke et al. (2006).

9 Gao et al. (2010).

10 Confidence interval crossed both ends of default MID.

Abbreviations: CI, confidence interval; GI, gastrointestinal; ITT, intention to treat; MID, minimal important difference; RR, relative risk.

K2: Example of an uncompleted GRADE profile

Quality assessment

No. of patients

Effect

Quality

Importance

No of studies

Design

Risk of bias

Inconsistency

Indirectness

Imprecision

Other considerations

.

.

Relative (95% CI)

Absolute

X

X

X

X

X

X

[References, abbreviations and other footnotes].

K3: Worked example of an economic evidence profile

Adapted from Crohn's disease: management in adults, children and young people (NICE clinical guideline 152).

Systematic review of economic evaluations of budesonide for maintenance of remission in Crohn's disease

Study

Limitations

Applicability

Other comments

Incremental

Uncertainty

Costs

Effects

ICER

Noble 1998 Budesonide CIR versus no maintenance therapy

Potentially serious limitations1,2

Partially applicable3

Study employed a Markov decision-analytic model with a 1-year time horizon

£115

0.017 QALYs5

£6,981 per QALY gained

ICER decreases significantly if the cost of surgery is increased.

NCGC model

Oral budesonide versus no maintenance therapy4

Potentially serious limitations2

Directly applicable

Study employed a Markov decision-analytic model with a 2-year time horizon

£477f

£1507

£5288

£3369

0.012 QALYs6

0.012 QALYs7

0.006 QALYs8

0.005 QALYs9

£40,392 per QALY gained6

£15,070 per QALY gained7

£87,610 per QALY gained8

£65,013 per QALY gained9

No treatment most cost-effective option when baseline risk of relapse decreased.

In the PSA, probability of budesonide being the most cost-effective treatment at willingness-to-pay threshold of £20,000 per QALY gained ranged from 0 to 8%

1 Modelling was undertaken over a short time horizon and no probabilistic sensitivity analysis was conducted.

2 Specific costs and disutilities of drug-related adverse events could not be explicitly modelled. Adverse events were captured by modelling treatment-specific withdrawal rates. This may have overestimated the cost effectiveness of maintenance treatment.

3 The cost-effectiveness model was designed to reflect the management of Crohn's disease in the Swedish healthcare setting. Although a cost per QALY estimate was reported, it was not based on health-related quality of life values elicited from patients.

4 The NCGC model compared a number of different maintenance treatments.

5 Figures may differ because of rounding off.

6 Conservative 4-line model. Conservative treatment effects were used and people relapsing while on azathioprine maintenance treatment had a different induction sequence.

7 Conservative 3-line model. Conservative treatment effects were used and people were assumed to have the same induction sequence regardless of maintenance treatment.

8 Non-conservative 4-line model. Non-conservative treatment effects were used and people relapsing while on azathioprine maintenance treatment had a different induction sequence.

9 Non-conservative 3-line model. Conservative treatment effects were used and people were assumed to have the same induction sequence regardless of maintenance treatment.

K4: Example of an uncompleted economic evidence profile

Study

Limitations

Applicability

Other comments

Incremental

Uncertainty

Costs

Effects

ICER

.

.

.

.

.

[References, abbreviations and other footnotes].


This page was last updated: