4 Committee discussion

The appraisal committee reviewed the data available on the clinical and cost effectiveness of canagliflozin, dapagliflozin and empagliflozin as monotherapies, having considered evidence on the nature of type 2 diabetes and the value placed on the benefits of canagliflozin, dapagliflozin and empagliflozin as monotherapies by people with the condition, those who represent them, and clinical experts. It also took into account the effective use of NHS resources.

4.1

The committee considered the experience of people with diabetes. It heard from the patient expert that she felt there was a lack of understanding about diabetes in the general population and variable knowledge and understanding of the condition among healthcare professionals. She felt there was stigma associated with type 2 diabetes because lifestyle factors may contribute to its development. The patient expert described her experience of treatment. She explained how she felt she had been given mixed messages about the most appropriate treatment, and sometimes felt that she had more knowledge about her diabetes management than some of her clinicians. The clinical experts agreed with these concerns, stating that treatment options are complex. The patient expert went on to describe the benefits of treatment with sodium‑glucose cotransporter 2 drugs (SGLT‑2s; canagliflozin, dapagliflozin and empagliflozin). She felt that this treatment was effective, and easy and flexible to administer, leaving her less stressed, more positive, and better able to manage her own condition. As a result her family were less concerned about her. The committee also noted that diabetes can be associated with many unpleasant complications, some of which could affect the person's ability to manage their condition, such as worsening eyesight or blindness. The committee concluded that diabetes has a substantial effect on quality of life, and that people with diabetes and their clinicians would value having an additional treatment option to help manage the disease.

4.2

The committee considered the current treatment pathway for people with diabetes who cannot tolerate metformin. It heard from the clinical experts that metformin can cause gastrointestinal problems. Although it is estimated that approximately 5% to 15% of people cannot tolerate metformin, this may vary; people can develop metformin intolerance over time. Modified‑release metformin can reduce some of the gastrointestinal symptoms but many people were reluctant to try metformin again if they had unpleasant gastrointestinal side effects before. For people who cannot tolerate metformin, there were several other treatment options available. The clinical experts agreed that dipeptidyl peptidase‑4 (DPP‑4) inhibitors and sulfonylureas were the most commonly used treatments, and sometimes pioglitazone was appropriate. However, they emphasised that individual care is critical, because there is no 'one size fits all' treatment. For example, sulfonylureas may be less appropriate if people drive for a living, and pioglitazone is usually not appropriate if people have heart failure. The committee also heard from the clinical and patient experts that in clinical practice in primary care (where about 80% of type 2 diabetes is managed) there is variation in care, because of confusion about which treatments are most appropriate for individual people. There are around 8 classes of treatments, all with different contraindications, and when combined with individual patient factors, this makes it very difficult to know the best option for individuals. The committee asked the clinical experts if repaglinide, a comparator in the scope for this appraisal, was used in clinical practice. The clinical experts all agreed that repaglinide is rarely used; of half a million recent prescriptions for diabetes in Wales, only 4 were for repaglinide. The committee concluded that the most appropriate comparators for this appraisal were DPP‑4 inhibitors, sulfonylureas and pioglitazone, but that in clinical practice the most appropriate comparator would depend on individual patient circumstances.

Clinical effectiveness

4.3

The committee discussed the clinical trials identified in the assessment group (AG) report and the company submissions. It was aware that the AG had not identified any additional trials to those originally identified in the company submissions, and that the AG considered the trials to be generally of good quality. The committee concluded that all relevant trials had been identified, and were of an appropriate quality for decision‑making.

4.4

The committee discussed the baseline patient characteristics in the clinical trials. It questioned whether the results were generalisable to UK clinical practice, because several of the trials were done in populations described as 'Asian' (for example, China and Japan). It heard from the clinical experts that baseline measurements such as BMI were likely to vary between these trial populations and the UK population (the UK population is likely to have a higher BMI). This was an important consideration when interpreting secondary outcomes such as weight. However, overall the clinical experts stated they had no concerns about generalisability because:

  • there were still people in the clinical trials with high BMIs

  • the primary outcome, change in HbA1c, was based on a physiological response to the drug, which would not generally be affected by baseline measurements such as BMI and

  • patient outcomes seen in UK clinical practice reflected the positive results seen in the clinical trials.

    The committee concluded that the trials were relevant to UK practice and appropriate for decision‑making.

4.5

The committee discussed the results of the clinical trials, most of which had compared SGLT‑2 inhibitors with placebo for outcomes such as change in HbA1c and weight. The committee was aware that the SGLT‑2 inhibitors had shown statistically significant improvements compared with placebo for the primary outcome of change in HbA1c. The clinical experts stated that this is the main goal of treatment with medication for diabetes. People had also had reductions in weight compared with placebo, which the clinical experts described as a welcome additional benefit of the SGLT‑2 inhibitors. The committee concluded that the SGLT‑2 inhibitors were a clinically effective treatment compared with placebo.

4.6

The committee considered if there was any evidence of differences in effectiveness between the SGLT‑2 inhibitors. It heard from the clinical experts that although it could be advantageous to have the option to increase the dose (as was possible with canagliflozin and empagliflozin), there was no direct evidence available to determine if there are clinically meaningful differences among the SGLT‑2 inhibitors. In response to the appraisal consultation document, Janssen (the company for canagliflozin) stated that although it agreed there was no direct evidence available, the indirect evidence from the AG and company network meta‑analyses (see sections 3.11 to 3.23) demonstrated that canagliflozin was the most effective treatment. The committee was aware that some results showed differences between the SGLT‑2 inhibitors. For example, some of the network meta‑analyses suggested dapagliflozin had a lower HbA1c response than canagliflozin and empagliflozin. However, it heard from the AG and AstraZeneca (the company for dapagliflozin) that the results for dapagliflozin were sensitive to the inclusion of a trial that had different baseline patient characteristics to the others, and when this was removed results were similar to the other SGLT‑2 inhibitors. The committee also noted that the differences in effectiveness between the SGLT‑2 inhibitors in the network meta‑analyses were most pronounced in people having the higher doses of canagliflozin and empagliflozin, which were not licensed starting doses. The committee agreed that the results demonstrated in the higher dose groups, which were derived from clinical trials where patients were able to start on the higher doses, may not be seen in clinical practice, where people eligible for and requiring a higher dose would be required to titrate up to it. Furthermore, the committee heard from Janssen that in clinical practice the majority of patients use the lower, 100 mg, starting dose of canagliflozin. The committee concluded that from the evidence available it was not possible to determine if there are any differences in effectiveness between the SGLT‑2 inhibitors.

4.7

The committee discussed the adverse events associated with SGLT‑2 inhibitors. It heard from the clinical experts that genital fungal infections were a concern. However, there is debate about whether this is a treatment or disease‑related effect, and when infections did occur, they were typically one‑off and were not serious. Furthermore, for more serious outcomes such as malignancy, the clinical experts stated that there were no data to suggest an increase in risk associated with SGLT‑2 inhibitors (although long‑term data are needed). The committee also heard from the patient about her experience with SGLT‑2 inhibitors. The patient expert had not had any adverse events. She noted that she had been advised to drink plenty of water, which had probably reduced her risk of having an adverse event, although this resulted in an increased need to pass water, which could be an inconvenience for some people. The committee concluded that the SGLT‑2 inhibitors had an acceptable adverse event profile.

Cost effectiveness

4.8

The committee discussed the structure of the AG and company models, considering if any single model was most appropriate for decision making. It was aware that the AG considered all the models to be of reasonable quality, and it noted that the structure of the models was generally similar, but there were some important differences. For example, the Janssen model assumed a 'linear in segment' (see section 3.30) progression of HbA1c whereas all other models based progression of disease on the UK Prospective Diabetes Study (UKPDS) equations. Furthermore, the AG model assumed that when people intensified treatment, treatments were added, rather than switched (as assumed in all company models at either first or second intensification). The committee heard from the clinical experts that the AG model was the most similar to NHS clinical practice, because clinicians typically retain oral therapies and add another treatment, to reduce the risk of losing control of the disease. Furthermore, the committee noted that NICE's guideline on type 2 diabetes had used the same model used by the AG (OM1, see section 3.27), preferring it to other models because it was based on 1 trial only (the committee was aware this was unlike ECHO‑T2DM which was based on multiple sources) and also because it matched the NICE reference case, was internally and externally validated, and allowed for modelling of additional short‑term outcomes. The committee was aware that in response to the appraisal consultation document, Janssen had described several advantages of the ECHO‑T2DM model over the other submitted models. For example, it stated that ECHO‑T2DM does not double count the treatment effect associated with rescue medication, unlike other models. The committee acknowledged there were different advantages and disadvantages to the different modelling approaches, and it agreed with the AG that all models submitted were appropriate and of a reasonable quality. However it concluded that the AG model was most appropriate for decision‑making, because of its more accurate reflection of treatment intensification.

4.9

The committee discussed the quality‑of‑life assumptions in the AG and company models. It noted that there were generally very small quality‑adjusted life year (QALY) differences between the various treatments. It also noted that the AG had presented a number of scenarios varying the assumptions about BMI. 'No BMI' assumed BMI had no impact on quality of life (worst‑case scenario for SGLT‑2 inhibitors), and BMI scenarios 1 to 5 varied the duration of treatment effect on weight loss (where BMI‑1, with weight changes maintained with no rebound to natural history, was the best‑case scenario for SGLT‑2 inhibitors). The committee agreed that weight loss does affect quality of life and agreed with the approach of a disutility of 0.0061 being applied per BMI point greater than 25. The committee noted that the evidence had shown that SGLT‑2 inhibitors do have a significant effect on weight loss, and felt that the AG's BMI‑2 scenario (in which weight gains were maintained and weight losses rebounded to natural history after 1 year) best reflected the treatment effect on weight loss. The committee noted that in response to the appraisal consultation document, Janssen stated it considered the 'BMI‑3' scenario (where weight gains were maintained, and weight losses rebound to natural history at intensification) to be the most appropriate scenario based on expert clinical opinion, although it had noted a lack of evidence to support any assumptions about the duration of weight loss. The committee agreed there is a lack of long‑term evidence to support firm conclusions about the duration of treatment‑related weight change. However it noted that NICE's guideline on type 2 diabetes used the same assumption for the duration of weight gains and losses as that used in scenario BMI‑2, because the clinical evidence on treatment‑related weight‑change was presented at follow‑up of 1 year and 2 years, but was very limited at 2 years. The committee therefore concluded that BMI‑2 was the most plausible scenario, but noted that the small QALY differences between treatments made the ICERs unstable.

4.10

The committee discussed the cost‑effectiveness results presented in the AG and company models. It noted that the Janssen model had highly favourable ICERs of £4,400 to £7,900 per QALY gained for canagliflozin 100 mg or 300 mg compared with sulfonylureas, whereas ICERs in the other models were substantially higher (for example, £59,000 per QALY gained for the SGLT‑2 inhibitors compared with the sulfonylureas in the AstraZeneca model, and £71,000 per QALY gained in the AG model using the BMI‑2 scenario). The committee heard from the AG that it considered the most probable driver of the differences between the AG and Janssen cost‑effectiveness results to be the different modelling assumptions used for treatment intensification (see section 3.33). Discontinuing oral therapies when intensifying to insulin meant that patients received the relatively expensive oral therapies for a relatively short period of time in the Janssen model, contributing to lower incremental costs for canagliflozin relative to a sulfonylurea when compared with the AG model. The committee noted that the Janssen model showed total costs for canagliflozin 300 mg were around £500 more expensive than a sulfonylurea, whereas in the AG model total costs were around £5,000 more expensive. The committee concluded there was uncertainty about the reason for the favourable cost‑effectiveness results for canagliflozin compared with a sulfonylurea in the Janssen model, but that the increased costs arising from retaining oral treatments in the AG model (a committee preferred assumption) was likely to be an important contributing factor.

4.11

The committee discussed whether it could determine the most plausible ICERs for the SGLT‑2 inhibitors compared with the relevant comparators (compared with each other, pioglitazone, sulfonylureas and DPP‑4 inhibitors), using its preferred model (AG model, see section 4.8) and its preferred assumptions about the effect of treatment on BMI (scenario BMI‑2, see section 4.9).

  • When compared with pioglitazone, ICERs for all the SGLT‑2 inhibitors were more than £52,400 per QALY gained.

  • When compared with sulfonylureas, ICERs for the SGLT‑2 inhibitors were all over £71,000 per QALY gained.

  • When compared with DPP‑4 inhibitors, the ICERs for all SGLT‑2 inhibitors were less than £29,300 per QALY gained.

  • When the SGLT‑2 inhibitors were compared with each other, the committee agreed that the clinical evidence (see section 4.6) and cost data (all tablets cost the same and had the same frequency of administration) did not support any differences between them.

4.12

The committee discussed the most plausible ICERs. For canagliflozin 300 mg, the committee noted that its preferred base case result from the AG had been updated following responses to the appraisal consultation document (to use a corrected value for systolic blood pressure for canagliflozin, see section 3.57). This had reduced the ICER when compared with sulfonylureas or pioglitazone to at least £52,400 per QALY gained, the lowest cost‑effectiveness estimates of the SGLT‑2 inhibitors, but still not within the range usually considered to be a cost‑effective use of NHS resources. The committee also noted that even these ICERs were possibly optimistic, because the clinical‑effectiveness assumptions were based on the more favourable results of the 300 mg dose, which was not the most commonly used dose in clinical practice (see section 4.6). In summary, at ICERs of £20,000 to £30,000 per QALY gained, the SGLT‑2 inhibitors were cost effective compared with DPP‑4 inhibitors, but not cost effective compared with pioglitazone and sulfonylureas. Therefore the committee concluded that canagliflozin, dapagliflozin and empagliflozin as monotherapy were a cost‑effective use of NHS resources, but only when pioglitazone or sulfonylureas were not appropriate treatment options.

4.13

The committee discussed the most appropriate wording of the final recommendation. It considered whether to recommend that the least costly SGLT‑2 inhibitor should be used first. However, because all the SGLT‑2 inhibitors cost the same per tablet and have the same dosing frequency, and the clinical data had not robustly demonstrated that any one SGLT‑2 inhibitor was more clinically effective than the others (see section 4.6), it could not determine a meaningful way to differentiate treatments by cost. It also noted concerns raised in response to the appraisal consultation document from Janssen (the company for canagliflozin) that the wording of the draft recommendation implied that a sulfonylurea or pioglitazone should be used before SGLT‑2 inhibitors or DPP‑4 inhibitors, which could affect individualisation of care. The committee discussed whether there was a need to reword the draft recommendation when the final guidance was published. It stated that the existing wording of the recommendation reflected the evidence base, and that the phrasing of the recommendation that SGLT‑2 inhibitors are only recommended where 'a sulfonylurea or pioglitazone was not appropriate' still allowed for clinical choice and individualisation of care; the recommendation does not imply that any treatments have to be tried first if they are not appropriate. The committee agreed that the wording of the recommendation allowed clinicians the freedom to prescribe SGLT‑2 inhibitors when they feel it is appropriate. It also agreed that there was no meaningful way to recommend a hierarchy of SGLT‑2 inhibitors based on cost. It therefore concluded that the final wording of the recommendation should remain the same as the draft recommendation that was consulted on.

4.14

The committee considered whether it should take into account the consequences of the Pharmaceutical Price Regulation Scheme (PPRS) 2014, and in particular the PPRS payment mechanism, when appraising canagliflozin, dapagliflozin and empagliflozin as monotherapy. The committee noted NICE's position statement in this regard, and accepted the conclusion 'that the 2014 PPRS payment mechanism should not, as a matter of course, be regarded as a relevant consideration in its assessment of the cost effectiveness of branded medicines'. The committee heard nothing to suggest that there is any basis for taking a different view with regard to the relevance of the PPRS to this appraisal of canagliflozin, dapagliflozin and empagliflozin as monotherapy. It therefore concluded that the PPRS payment mechanism was not relevant for its consideration of the cost effectiveness of canagliflozin, dapagliflozin and empagliflozin as monotherapy.

Summary of appraisal committee's key conclusions

Key conclusion

  • Sections 1.1, 4.6, 4.11, and 4.12: The committee, using its preferred model from the assessment group (AG) and its preferred assumptions about the effect of treatment on BMI (scenario BMI‑2), discussed the most plausible incremental cost‑effectiveness ratios (ICERs) presented:

    • When compared with pioglitazone, ICERs for all the SGLT‑2 inhibitors were more than £52,400 per quality‑adjusted life year (QALY) gained.

    • When compared with sulfonylureas, ICERs for the SGLT‑2 inhibitors were all over £71,000 per QALY gained.

    • When compared with DPP‑4 inhibitors, the ICERs for all SGLT‑2 inhibitors were less than £29,300 per QALY gained.

    • When the SGLT‑2 inhibitors were compared with each other, the committee agreed that the clinical evidence and cost data (all tablets cost the same and had the same frequency of administration) did not support any differences between them.

  • At ICERs of £20,000 to £30,000 per QALY gained, the SGLT‑2 inhibitors were cost effective compared with DPP‑4 inhibitors, but not cost effective compared with pioglitazone and sulfonylureas. Therefore, the committee concluded that canagliflozin, dapagliflozin and empagliflozin as monotherapy are a cost‑effective use of NHS resources for treating type 2 diabetes in adults for whom metformin is contraindicated or not tolerated, and when diet and exercise alone do not provide adequate glycaemic control, but only when pioglitazone or sulfonylureas are not appropriate treatment options.

Current practice

Clinical need of patients, including the availability of alternative treatments
  • Section 4.1: The committee heard from the patient expert that she felt there was a lack of understanding about diabetes in the general population and a stigma associated with type 2 diabetes because it can be caused by lifestyle factors. The committee also noted that diabetes can be associated with many unpleasant complications, some of which could affect the person's ability to manage their condition, such as worsening eyesight or blindness.

  • The patient expert felt that SGLT‑2 inhibitors are effective, and easy and flexible to administer, leaving her less stressed, more positive, and better able to manage her own disease.

  • The committee concluded that diabetes has a substantial effect on quality of life, and that people with diabetes and their clinicians would value having an additional treatment option to help manage the disease.

The technology

How innovative is the technology in its potential to make a significant and substantial impact on health‑related benefits?
  • Section 4.5: The committee was aware that the SGLT‑2 inhibitors had shown statistically significant improvements compared with placebo for the primary outcome of change in haemoglobin A1c (HbA1c), and that people had also had reductions in weight compared with placebo, which the clinical experts described as a welcome additional benefit of the SGLT‑2 inhibitors.

What is the position of the treatment in the pathway of care for the condition?
  • Sections 2.1 and 4.2: Canagliflozin, dapagliflozin and empagliflozin all have UK marketing authorisations as monotherapy for treating type 2 diabetes to improve glycaemic control in adults when diet and exercise alone do not provide adequate glycaemic control, in people for whom the use of metformin is considered inappropriate due to intolerance or contraindications. The committee was aware there are several other treatment options available. The clinical experts agreed that dipeptidyl peptidase‑4 (DPP–4) inhibitors and sulfonylureas are the most commonly used treatments, and sometimes pioglitazone is appropriate. However, they emphasised that individual care is critical, because there is no 'one size fits all' treatment.

Adverse reactions
  • Section 4.7: The committee heard from the clinical experts that genital fungal infections are a concern. However, there is debate about whether this is a treatment or disease‑related effect, and when infections do occur, they are typically one‑off and not serious.

  • For more serious outcomes such as malignancy, the clinical experts stated that there are no data to suggest an increase in risk associated with SGLT‑2 inhibitors (although long‑term data are needed).

  • The committee also heard from the patient that she had not experienced any adverse events.

  • The committee concluded that the SGLT‑2 inhibitors had an acceptable adverse event profile.

Evidence for clinical effectiveness

Availability, nature and quality of evidence
  • Sections 4.3 and 4.6: The committee concluded that all relevant trials had been identified, and were of an appropriate quality for decision‑making.

  • The committee considered if there was any evidence of differences in effectiveness between the SGLT‑2 inhibitors. It heard from the clinical experts that there was no direct evidence available to determine if there are clinically meaningful differences among the SGLT‑2 inhibitors. The committee concluded that from the evidence available it was not possible to determine if there are any differences in effectiveness between the SGLT‑2 inhibitors.

Relevance to general clinical practice in the NHS
  • Section 4.4: The committee heard from the clinical experts that baseline measurements such as BMI would likely vary between the trial populations and the UK population, and this was an important consideration when interpreting secondary outcomes such as weight. However, overall the clinical experts stated they had no concerns about generalisability because there were people in the clinical trials with high BMIs; the primary outcome (change in HbA1c) was based on a physiological response to the drug, which would not generally be affected by baseline measurements such as BMI; and patient outcomes seen in UK clinical practice reflected the positive results seen in the clinical trials.

Uncertainties generated by the evidence
  • Section 4.6: The committee concluded that from the evidence available it was not possible to determine if there are any differences in effectiveness between the SGLT‑2 inhibitors.

Estimate of the size of the clinical effectiveness including strength of supporting evidence
  • Sections 4.5 and 4.6: The evidence included 7 clinical trials and company and assessment group network meta‑analyses. The committee concluded that the SGLT‑2 inhibitors were a clinically effective treatment compared with placebo.

Evidence for cost effectiveness

Availability and nature of evidence
  • Section 3.26: The AG and all the companies used existing economic models for diabetes to consider the cost effectiveness of SGLT‑2 inhibitor monotherapy.

Uncertainties around and plausibility of assumptions and inputs in the economic model
  • Sections 4.10 and 4.9: The committee noted that the Janssen model had highly favourable ICERs of £4,400 to £7,900 per QALY gained for canagliflozin 100 mg or 300 mg compared with sulfonylureas, whereas ICERs in the other models were substantially higher. The committee concluded there was uncertainty about the reason for the favourable cost‑effectiveness results for canagliflozin compared with a sulfonylurea in the Janssen model, but that the increased costs arising from retaining oral treatments (a committee preferred assumption) was likely to be an important contributing factor.

  • The committee noted that the small QALY differences between treatments made the ICERs unstable.

Have any potential significant and substantial health‑related benefits been identified that were not included in the economic model, and how have they been considered?
  • Section 4.9: The committee noted that there were generally very small QALY differences between the various treatments. It also noted that the AG had presented a number of scenarios varying the impact of BMI on quality of life. Overall the committee agreed that weight loss does affect quality of life and that the evidence had shown that SGLT‑2 inhibitors do have a significant effect on weight loss. It noted that NICE's guideline on type 2 diabetes used the same assumption for the duration of weight gains and losses as that used in scenario BMI‑2. It concluded that BMI‑2 was the most plausible scenario, but noted that the small QALY differences between treatments made the ICERs unstable.

What are the key drivers of cost effectiveness?
  • Section 4.9: The key driver of cost effectiveness was the BMI scenario chosen. The committee concluded that BMI‑2 was the most plausible scenario, but noted that the small QALY differences between treatments made the ICERs unstable.

Most likely cost‑effectiveness estimate (given as an ICER)
  • Sections 4.11 and 4.12: When the SGLT‑2 inhibitors were compared with each other, the committee agreed that the clinical and cost evidence did not support any differences between them.

  • When compared with pioglitazone, ICERs for all the SGLT‑2 inhibitors were more than £52,400 per QALY gained.

  • When compared with sulfonylureas, ICERs for the SGLT‑2 inhibitors were all more than £71,000 per QALY gained.

  • When compared with DPP‑4 inhibitors, the ICERs ranged from £3,600 to £29,300 per QALY gained.

  • National Institute for Health and Care Excellence (NICE)