4 Consideration of the evidence

The Appraisal Committee reviewed the data available on the clinical and cost effectiveness of teriflunomide, having considered evidence on the nature of active relapsing–remitting multiple sclerosis and the value placed on the benefits of teriflunomide by people with the condition, those who represent them, and clinical specialists. It also took into account the effective use of NHS resources.

4.1 The Committee heard from the clinical specialists and patient experts about the nature of the condition. It was aware that relapsing–remitting multiple sclerosis is a chronic, disabling, neurological condition that, as it progresses, can be life altering and have a substantial negative impact on quality of life and activities of daily living. The patient experts emphasised that people with multiple sclerosis can lose independence and are often not able to continue working. The Committee heard from a patient expert that only 25% of people with multiple sclerosis are employed compared with 75% of the general population who are of working age, and that 80% of people who have had multiple sclerosis for 15 years or more do not work. The patient experts emphasised the importance of having access to new treatments that could reduce the number of relapses and therefore slow the accumulation of disability. The Committee noted that most current treatments for active relapsing–remitting multiple sclerosis need to be injected and may be associated with unpleasant side effects (such as injection-site reactions, or flu-like symptoms, fatigue and depression) and can significantly affect patients' emotional wellbeing. A patient expert described experiencing 2 or 3 days of feeling very unwell from flu-like symptoms after injecting treatment, followed by 3 days of dreading the next injection, and commented that they had taken time off work because of the side effects of treatment. The Committee heard from the patient experts that some people find it difficult to inject because of the stigma attached with taking an injection. It also heard that because teriflunomide is given orally and has a different side-effect profile than currently available treatments, it would be very beneficial. The Committee understood that any delay in relapse and progression of disability or relief from using injectable treatments would have a positive impact on the lives of people with multiple sclerosis and their families.

4.2 The Committee discussed the management of active relapsing–remitting multiple sclerosis and considered the likely position of teriflunomide in the treatment pathway for adults with active relapsing–remitting multiple sclerosis. It heard from the clinical specialists that most patients with active relapsing–remitting multiple sclerosis who have had 2 relapses in the previous 2 years would be offered a disease-modifying therapy (one of the beta interferons [Avonex, Rebif, Betaferon, Extavia] or glatiramer acetate), in line with the Association for British Neurologists' guidelines. The Committee heard from the clinical specialists that in the UK clinical practice treatment varies and that there is no clear treatment pathway. The clinical specialists explained that the choice of whether to take glatiramer acetate or beta interferon, and which beta interferon to take, was a decision made between the clinician and the patient, taking into account the patient's views and thoughts on the route and schedule of administration, the side-effect profile and how the drug is stored. The Committee was aware that beta interferons and glatiramer acetate were not recommended in Beta interferon and glatiramer acetate for the treatment of multiple sclerosis (NICE technology appraisal guidance 32). However, it acknowledged that after this guidance was issued, the Department of Health agreed a risk-sharing scheme with manufacturers through which disease-modifying treatments for multiple sclerosis can be provided to patients in the NHS at a level that the Department of Health considers to be cost effective, and that use of disease-modifying therapies has become firmly established practice in the NHS. The Committee was aware that the role of disease-modifying therapies decreases as a patient's Expanded Disability Status Scale (EDSS) score increases, and stopping treatment is determined by the accumulation of disability (reaching EDSS 7) or by the development of secondary progressive multiple sclerosis. The clinical specialists commented that in clinical practice teriflunomide would be considered as a treatment option in the same way as glatiramer acetate or beta interferons. The Committee understood that teriflunomide would be used in line with the Association for British Neurologists' guidelines, and that it would be stopped if the person's condition converted to secondary progressive multiple sclerosis, or reached EDSS state 7.

4.3 The Committee discussed the management of rapidly evolving severe relapsing–remitting multiple sclerosis and highly active relapsing–remitting multiple sclerosis. It was aware that, in Natalizumab for the treatment of adults with highly active relapsing–remitting multiple sclerosis (NICE technology appraisal guidance 127), natalizumab is recommended for treating rapidly evolving severe relapsing–remitting multiple sclerosis (defined as 2 or more disabling relapses in 1 year, and 1 or more gadolinium-enhancing lesions on brain MRI or a significant increase in T2 lesion load compared with a previous MRI). The Committee heard from the clinical specialists that more aggressive disease is difficult to identify in the first 2 years of onset but, for these people, natalizumab would be considered the most appropriate first-line treatment option. The Committee was aware that Fingolimod for the treatment of highly active relapsing–remitting multiple sclerosis (NICE technology appraisal guidance 254) recommends fingolimod for treating highly active relapsing–remitting multiple sclerosis in adults, only if they have an unchanged or increased relapse rate or ongoing severe relapses compared with the previous year despite treatment with beta interferon. The clinical specialists highlighted to the Committee that, because of the lack of treatment options for patients with rapidly evolving severe relapsing–remitting multiple sclerosis and highly active relapsing–remitting multiple sclerosis, teriflunomide may be considered as an option for these patients, but it would not be used routinely.

Clinical effectiveness

4.4 The Committee discussed the clinical-effectiveness evidence from the trials. The Committee understood that the marketing authorisation included all people with relapsing–remitting multiple sclerosis, but that the trials included people who had 1 relapse in the last year or 2 in the last 2 years, and therefore were patients with more severe relapsing–remitting multiple sclerosis than the general population with relapsing–remitting multiple sclerosis; that is, they had active disease. It heard from the clinical specialists that the trial populations broadly represented patients who would be offered beta interferon or glatiramer acetate in the UK, in line with the Association of British Neurologists' guidelines. The Committee therefore concluded that the trial populations appropriately represented the decision problem because these would be the people who would receive treatment with disease-modifying treatment in the UK.

4.5 The Committee agreed that there was sufficient evidence to conclude that, compared with placebo, teriflunomide statistically significantly reduced annualised relapse rates in both the TEMSO and TOWER trials and the meta-analyses (see section 3.4), and that the proportion of people who experienced 3‑month sustained accumulation of disability (SAD) was reduced with teriflunomide compared with placebo and that this difference was statistically significant in the TEMSO trial and in the meta-analysis (see section 3.4). The Committee agreed, however, that there was no statistically significant difference between teriflunomide and placebo in 6‑month SAD in either of the placebo-controlled trials (see section 3.4). The Committee concluded that teriflunomide was clinically effective in reducing relapse rates compared with placebo, and that teriflunomide may have a beneficial impact on accumulation of disability compared with placebo.

4.6 The Committee discussed the appropriateness of reporting 3‑month SAD rather than 6‑month SAD. It heard from the clinical specialists that recovery from relapse may continue for up to 12 months, but on average, recovery from the disabling effects of a relapse will be seen within 3 or 4 months. The clinical specialists stated that 6‑month SAD is therefore a more robust outcome measure than 3‑month SAD for measuring disability progression. The Committee was also aware that sustained disability progression confirmed for 6 months was preferred by the European Medicines Agency in its draft guideline for the clinical investigation of medicinal products for the treatment of multiple sclerosis. The Committee was aware that most of the multiple sclerosis trials measured 3‑month SAD. It acknowledged that this outcome had been considered in previous multiple sclerosis appraisals and that it therefore should be considered in its decision-making. However, the Committee concluded that, although sustained disability progression confirmed for 6 months provides a more robust indication of the treatment effect when measuring disability progression, in light of the lack of 6‑month SAD data available, 3‑month SAD data should be considered.

4.7 The Committee discussed the mixed treatment comparison (MTC) presented by the manufacturer that compared teriflunomide with the beta interferons and glatiramer acetate. It noted that the manufacturer had presented a base-case MTC, which had excluded trials that recruited patients before the year 2000 ('post-2000'), and one that included all trials ('all years') (see section 3.6). The Committee acknowledged that trials carried out before the year 2000 were excluded because of changes in diagnostic criteria, which has resulted, in part, in changes in baseline relapse rates over time, but were concerned that important trials were excluded because of the cut-off date, including all trials comparing beta interferons with placebo (see section 3.29). The Committee agreed that an MTC should include all available evidence and that, in this case, adjusting the MTC for baseline relapse rates would account for any differences in relapse rates between trials. The Committee noted that the results from the adjusted 'all years' MTC, provided in response to consultation, were similar to those from the 'all years' MTC (see section 3.43). The Committee concluded that the adjusted MTC was the most appropriate and that, based on the MTC, there was no difference in effectiveness between teriflunomide and the beta interferons or glatiramer acetate (see section 3.43).

4.8 The Committee discussed the TENERE trial, which did not show any statistically significant differences in annualised relapse rate between teriflunomide and the active comparator Rebif‑44 (interferon beta-1a, 44 micrograms) (see section 3.5). The Committee heard from the manufacturer that the primary outcome of the trial was time to failure and that the trial was not a non-inferiority or equivalence trial. It had been powered to test the hypothesis that people will stay on an oral drug with a different side-effect profile longer than on an injectable drug. The Committee noted that the TENERE trial was designed to show the benefits of an oral drug and had not been designed to compare the effectiveness of teriflunomide with Rebif. Therefore, the Committee concluded that the effectiveness of teriflunomide compared with Rebif‑44 was still uncertain, and that the MTC results did not show a difference in effectiveness.

4.9 The Committee discussed the evidence for the effectiveness of teriflunomide in patients with rapidly evolving severe relapsing–remitting multiple sclerosis or highly active relapsing–remitting multiple sclerosis, and the comparisons with natalizumab and fingolimod, respectively. The Committee noted that the manufacturer had stated in its submission that these were not key comparators for teriflunomide. The Committee noted that the MTC results favoured natalizumab and fingolimod for the outcome annualised relapse rate, and that no difference was found between teriflunomide and the 2 drugs for 3‑month SAD. However, the Committee agreed that the MTC results, being based on the whole trial population, did not provide relevant information for the subgroups. The Committee concluded that the indirect comparisons carried out for the subgroups could not be considered reliable because of the small patient numbers and the inadequate methodology used (see sections 3.10 and 3.42). It therefore concluded that the evidence was insufficient to make any conclusions about the clinical effectiveness of teriflunomide compared with natalizumab and fingolimod in the respective subgroups. It noted that the clinical specialists confirmed that teriflunomide would not be routinely used in people with aggressive disease (see section 4.3). The Committee also noted that no comments to support the use of teriflunomide in these subgroups were received during consultation on the appraisal consultation document. The Committee concluded that the evidence presented by the manufacturer was insufficient to recommend teriflunomide for treating highly active relapsing–remitting multiple sclerosis or rapidly evolving severe relapsing–remitting multiple sclerosis.

4.10 The Committee was aware of the adverse effects associated with teriflunomide (see section 3.11). The Committee discussed the risk of teratogenicity with teriflunomide, and the long 'washout' period (2 years) needed for women to have stopped treatment before trying to conceive. It agreed that this was a particular concern because multiple sclerosis affects women of childbearing age. The Committee recognised, however, that none of the disease-modifying drugs are recommended in pregnancy, and therefore it was a concern for all the multiple sclerosis treatments (although the washout period with teriflunomide is longer). The Committee considered this a notable concern, but concluded that no additional monitoring for teriflunomide had been recommended than that already given for treatment with the disease-modifying therapies and therefore it would not need to be reflected in the modelling for teriflunomide.

Cost effectiveness

4.11 The Committee discussed the revised base case provided by the manufacturer, the ERG's critique of the manufacturer's additional analyses, and the comments from patient and professional groups, commentators, patient experts and clinical specialists received in response to the appraisal consultation document. The Committee understood the manufacturer's model to be structurally similar to models used in previous NICE technology appraisals. The Committee agreed that the manufacturer's revised base case reflected the Committee's preferred analyses. That is, it used the ERG's preferred scenario (see section 3.40), and the following changes:

  • the 'all years' MTC adjusted for baseline relapse rates was used to estimate disease progression and withdrawal rates

  • treatment waning (75% treatment effect after 2 years and 50% treatment effect after 5 years) was included, and

  • the results were presented incrementally for all comparators rather than using a blended comparator.

4.12 The Committee discussed the external validation presented by the manufacturer in response to the appraisal consultation document. The Committee noted that the incremental cost-effectiveness ratios (ICERs) estimated by the manufacturer's revised model were substantially higher than those in NICE technology appraisal guidance 32 for most of the comparators, and that the manufacturer's model predicted slower disease progression and lower health-related quality of life than the UK risk sharing scheme (see section 3.52). The Committee noted the considerable uncertainty in the current analyses, and the analyses carried out for NICE technology appraisal guidance 32, and acknowledged that showing close convergence between the previous and present analyses was challenging. However, the Committee concluded that the manufacturer's model was sufficiently valid for decision-making in the current appraisal.

4.13 The Committee was aware from the original analyses that disease progression was the main driver of the ICERs; using the ERG's original preferred analyses, the ICER ranged from £6000 per QALY gained (deterministic, using the base-case MTC [post 2000]) to £107,000 per QALY gained (probabilistic, using the 'all years' MTC) for teriflunomide compared with glatiramer acetate. The Committee concluded that the most appropriate MTC to use was the 'all years' MTC adjusted for baseline relapse rate because it included all available studies and accounted for the differences in baseline relapse rates seen between studies. The Committee noted that this resulted in an ICER of £14,000 per QALY gained for teriflunomide compared with glatiramer acetate (as estimated by the ERG).

4.14 The Committee understood that withdrawal rates had a counterintuitive impact on the ICER, in that increasing the withdrawal rate reduced the ICER. The Committee noted from the ERG's exploratory analyses that, when the withdrawal rate from the 'all years' MTC rather than from the 'all years' MTC adjusted for baseline relapse was applied to the ERG's re-estimation of the manufacturers revised base-case analysis, the ICER for teriflunomide compared with glatiramer acetate increased from £14,000 to £23,000 per QALY gained (see section 3.50). In addition, when it was assumed that the withdrawal rates for glatiramer acetate and teriflunomide were equal, the estimated ICER was £33,000 per QALY gained. The Committee agreed that assuming withdrawal rates were equal was the most conservative approach, but that using the 'all years' MTC adjusted for baseline relapse rate to estimate withdrawal rates was appropriate.

4.15 The Committee discussed how the manufacturer's revised base case modelled the natural history of multiple sclerosis. It recognised that the placebo arms of the TEMSO and TOWER trials had been used to model the natural history of disease. The Committee noted that, in response to the consultation, the manufacturer had stated that using data from the placebo arms of the TOWER and TEMSO trials overestimated EDSS regression, especially at higher EDSS states, and that applying rates from the London Ontario data set for the higher EDSS states reduced the ICER. The Committee noted the inherent limitations associated with using the London Ontario data set to model the natural history of disease, namely, that it allowed only for movement to higher EDSS states, and that it reflected a cohort from the 1970s and 1980s. It agreed that it was appropriate for the model to allow movement to lower as well as to higher EDSS states, that is, to allow for the condition to both improve and get worse, which is in line with what is seen in clinical practice for the lower EDSS states. The Committee also heard from the clinical specialists that relapses are less likely to occur once patients are in higher EDSS states; and people are less likely to move to lower EDSS states. The Committee agreed that using the data from the placebo arms of the TOWER and TEMSO trials was appropriate for modelling disease progression.

4.16 The Committee heard from the clinical specialists that the health-related quality of life of people with multiple sclerosis was more closely related to EDSS state than to the clinical form of multiple sclerosis (that is, relapsing–remitting or secondary progressive). The clinical specialists stated that it is difficult to clearly identify when the condition becomes secondary progressive multiple sclerosis, and so it is also difficult to gauge the impact of progressing to secondary progressive multiple sclerosis on health-related quality of life. The Committee noted that, in the revised base case, the manufacturer had used clinical trial data to estimate utility values, where possible. For the higher EDSS states that could not be derived from clinical data, the manufacturer had extrapolated values using the differences in utility between EDSS states seen in Orme et al. (2007). The Committee agreed that this approach was appropriate.

4.17 The Committee discussed the disutility values incorporated in the model to reflect caregiver disutility, as in previous multiple sclerosis appraisals, and considered this to be appropriate. The Committee noted that the disutility values for adverse events included in the model were small (see section 3.15), and acknowledged the comment raised during consultation that a more extensive list of adverse events should be included in the model. The Committee understood that the disutility values did not have a large impact on the ICERs and therefore concluded that it did not need to consider the disutility values in the model further.

4.18 The Committee considered the duration of treatment benefit on disease progression, and noted that it remained constant over time in the manufacturer's original base case. That is, there was no option for the treatment benefit to decrease over time. It recognised that the long-term benefit was largely unknown but that it had a large impact on the outputs of the model. The Committee heard from the clinical specialists that they could not be confident that the treatment effect would not wane. The Committee acknowledged that, in the revised model, the manufacturer had included the assumption that the treatment effect decreased to 75% at 2 years and 50% at 5 years to explore a reduction of the long-term treatment effect. The Committee noted that applying treatment waning increased the ICER for teriflunomide compared with glatiramer acetate (from £10,000 to £13,000 per QALY gained, see section 3.45). The Committee agreed that it was important to include in the decision-making that the treatment effect could decrease over time but, given the uncertainty of how much the treatment effect would wane, the most plausible ICER was likely to lie between the estimates that included and excluded the modelled treatment waning effect.

4.19 The Committee considered the cost data used in the manufacturer's revised base case. It was concerned that the non-health costs contributed to a high proportion of the costs in the model, and it was unclear what proportion of these costs would include personal social services, and therefore would be appropriately included in the NICE reference case. The Committee acknowledged that the manufacturer had provided scenarios with and without non-health costs (with non-health costs: £13,000 per QALY gained compared with glatiramer acetate; without non-health costs: teriflunomide dominated glatiramer acetate). It recognised that the ERG's critique of the manufacturer's revised base case included a scenario using a cost midpoint, which increased the ICER slightly compared with including all non-health costs (deterministic ICER £3000 per QALY gained). The Committee understood that excluding all non-health costs was a conservative but arguably appropriate approach to adjusting the model's cost inputs to follow NICE's preferred perspective for analyses. The Committee concluded, however, that the most plausible ICER was likely to lie between the ICERs estimated with and without non-health costs, given the uncertainty about how much of the non-health costs from the cited sources were within the NICE reference case.

4.20 The Committee recognised that no specific sequence of disease-modifying treatments was standard practice in the NHS but that patients with active relapsing–remitting multiple sclerosis often receive more than 1 disease-modifying treatment over time. Therefore the Committee considered it important to explore how sensitive the ICERs were to the inclusion of more than 1 treatment. The Committee understood that teriflunomide may be added to the treatment pathway and, in this situation, the alternative treatment would be best supportive care. The Committee noted that the ERG's exploratory analysis comparing teriflunomide with best supportive care gave ICERs for teriflunomide of between £29,000 and £64,000 per QALY gained, depending on whether treatment waning or non-health costs were included. The Committee noted that these ICERs were lower than the ICERs for the disease-modifying treatments from the risk sharing scheme, when derived from the same model (the revised manufacturer's analysis). The Committee agreed that it was valuable to understand the impact on the ICER of including teriflunomide in a treatment sequence, or as an alternative to best supportive care (to account for adding to the treatment sequence), and agreed that for future technology appraisals in multiple sclerosis, a scenario in which a sequence is explored would be useful. However, the Committee concluded that the analysis of individual drugs (without a sequence) was the basis for decision-making in this appraisal because of:

  • the lack of an established common treatment pathway

  • the resulting uncertainties related to the modelling of sequencing

  • the difficulty with cross-model validation

  • the fact that considering treatment sequences formally in its recommendations would go beyond the scope of this appraisal.

4.21 The Committee discussed whether teriflunomide was innovative and noted the comments received during consultation on the appraisal consultation document. It recognised the limitations of the current treatments in terms of their side-effect profile and administration methods, and agreed that an oral treatment, with a different side-effect profile, would be beneficial for people with active relapsing–remitting multiple sclerosis. The Committee discussed whether there were health-related benefits associated with an oral treatment that were not captured in the modelling. It noted that the manufacturer's economic model assigned different disutilities for treatment-specific adverse events, including injection site reactions and that, therefore, some of the benefits of oral treatment had been captured, but possibly not all. The Committee concluded that teriflunomide was innovative and that additional health-related quality-of-life benefits related to the oral treatment may not have been captured fully.

4.22 The Committee considered the manufacturer's revised base-case results and the ERG's critique of these data, noting that teriflunomide dominated the beta interferons, and that the ICER for teriflunomide compared with glatiramer acetate was £14,000 per QALY gained. The Committee noted that excluding treatment waning reduced the ICER for teriflunomide compared with glatiramer acetate to £10,000 per QALY gained and that, when non-health costs were included, teriflunomide dominated the beta interferons and glatiramer acetate, irrespective of whether waning was included or excluded. The Committee acknowledged that when some non-health costs were included, as modelled by the ERG, the ICER for teriflunomide compared with glatiramer acetate was £3000 per QALY gained and that when withdrawal rates were assumed equal between teriflunomide and glatiramer acetate, as presented by the ERG, the ICER was £33,000 per QALY gained. The Committee concluded that teriflunomide dominated the beta interferons. For the comparison with glatiramer acetate, the Committee noted the varying ICERs from the different analyses and recognised that there were benefits not captured in the QALY, such as the oral administration of teriflunomide. The Committee concluded that, on balance, the most plausible ICER for teriflunomide compared with glatiramer acetate would be below £20,000 per QALY gained.

4.23 The Committee agreed there was insufficient evidence to appraise the cost effectiveness of teriflunomide compared with fingolimod for the highly active relapsing–remitting multiple sclerosis or with natalizumab for the rapidly evolving severe relapsing–remitting multiple sclerosis. The Committee therefore concluded that teriflunomide cannot be recommended for treating highly active relapsing–remitting multiple sclerosis or rapidly evolving severe relapsing–remitting multiple sclerosis. However, the Committee concluded that teriflunomide could be considered an effective use of NHS resources for treating relapsing–remitting multiple sclerosis in adults for whom beta interferons and glatiramer acetate would otherwise be considered as treatment options, that is, adults who have active relapsing–remitting multiple sclerosis, normally defined by 2 clinically significant relapses in the previous 2 years, and who do not have highly active relapsing–remitting multiple sclerosis or rapidly evolving severe relapsing–remitting multiple sclerosis, and only if the manufacturer provides teriflunomide with the discount agreed in the patient access scheme.

Summary of Appraisal Committee's key conclusions

TA303

Appraisal title: Teriflunomide for treating relapsing–remitting multiple sclerosis

Section

Key conclusion

Teriflunomide is recommended as an option for treating adults with active relapsing–remitting multiple sclerosis (normally defined as 2 clinically significant relapses in the previous 2 years), only if

  • they do not have highly active or rapidly evolving severe relapsing–remitting multiple sclerosis and

  • the manufacturer provides teriflunomide with the discount agreed in the patient access scheme.

1.1

Compared with placebo, teriflunomide reduced relapse rates, and may have a beneficial impact on accumulation of disability. Based on a mixed treatment comparison (MTC), there was no difference in effectiveness between teriflunomide and the beta interferons or glatiramer acetate.

4.5, 4.7, 4.8

The evidence was insufficient to make any conclusions about the clinical effectiveness of teriflunomide for the subgroups with highly active relapsing–remitting multiple sclerosis and rapidly evolving severe relapsing–remitting multiple sclerosis compared with natalizumab and fingolimod because the MTC, being based on the whole trial population, did not provide relevant information, and the indirect comparisons could not be considered reliable because of the small patient numbers and inadequate methodology used. Therefore, the Committee could not recommend teriflunomide for treating highly active relapsing–remitting multiple sclerosis and rapidly evolving severe relapsing–remitting multiple sclerosis.

4.9

Based on the revised modelling teriflunomide dominated the beta interferons. For the comparison with glatiramer acetate, the Committee concluded that, when accounting for the benefits associated with the oral administration, which were not captured in the modelling, the most plausible ICER for teriflunomide compared with glatiramer acetate would be below £20,000 per QALY gained.

4.22

Current practice

Clinical need of patients, including the availability of alternative treatments

Relapsing–remitting multiple sclerosis is a chronic, disabling, neurological condition that, as it progresses, can be life altering and have a substantial negative impact on quality of life and activities of daily living. Current treatments all need to be injected, and can be associated with unpleasant side effects. The Committee concluded that any delay in relapse and progression of disability or relief from using injectable treatments would have a positive impact on the lives of people with multiple sclerosis and their families.

4.1

The technology

Proposed benefits of the technology

How innovative is the technology in its potential to make a significant and substantial impact on health-related benefits?

The Committee agreed that, as an oral treatment with a different side-effect profile, teriflunomide offered a step change for treating relapsing–remitting multiple sclerosis, which could have a substantial impact on quality of life for people with relapsing–remitting multiple sclerosis.

4.1, 4.21

What is the position of the treatment in the pathway of care for the condition?

Teriflunomide would be considered for people with active relapsing–remitting multiple sclerosis as an option, in the same way as glatiramer acetate and the beta interferons, and would be used in line with the Association for British Neurologists' guidelines, and would be stopped if the person's condition converted to secondary progressive multiple sclerosis, or reached Expanded Disability Status Scale (EDSS) state 7.

4.2

Adverse reactions

The Committee understood that teriflunomide is associated with diarrhoea, nausea, vomiting, increased levels of alanine aminotransferase, parathesias and dysesthesias, infections and alopecia.

2.2

The Committee considered that the teratogenicity with teriflunomide, and the long 'washout' period (2 years) needed for women to have stopped treatment before trying to conceive is a notable concern, but concluded that no additional monitoring was recommended for teriflunomide over that already given for treatment with the disease-modifying therapies and therefore it would not need to be reflected in the modelling for teriflunomide.

4.10

Evidence for clinical effectiveness

Availability, nature and quality of evidence

The manufacturer provided evidence from 3 phase III clinical trials (TESMO, TOWER and TENERE), a phase II clinical trial, a meta-analysis, an MTC and an indirect treatment comparison. Two of the phase III clinical trials (TESMO and TOWER) and the phase II clinical trial compared the effectiveness of teriflunomide with placebo and were well conducted.

3.1, 3.4, 3.10

The Committee agreed that an MTC should include all available evidence and that, in this case, adjusting the MTC for baseline relapse rates would account for any differences in relapse rates between trials.

3.6, 4.7

Relevance to general clinical practice in the NHS

The Committee concluded that the trial populations appropriately represented the decision problem because these would be the people who would receive disease-modifying treatment in the UK.

4.4

Uncertainties generated by the evidence

The Committee was aware that, although a statistically significant improvement in 3‑month sustained accumulation of disability (SAD) was seen with teriflunomide, this was not seen for 6‑month SAD. The Committee concluded that teriflunomide may have a beneficial impact on accumulation of disability.

4.5, 4.6

The Committee noted that the TENERE trial was designed to show the benefits of an oral drug and had not been designed to compare the effectiveness of teriflunomide with Rebif. Therefore, the Committee concluded that the effectiveness of teriflunomide compared with Rebif-44 was still uncertain.

4.8

Are there any clinically relevant subgroups for which there is evidence of differential effectiveness?

The Committee agreed there was insufficient evidence to make recommendations for teriflunomide for people with highly active relapsing–remitting multiple sclerosis and rapidly evolving severe relapsing–remitting multiple sclerosis

4.9

Estimate of the size of the clinical effectiveness including strength of supporting evidence

The Committee concluded that teriflunomide was clinically effective in reducing relapse rates compared with placebo, and that it may have a beneficial impact on accumulation of disability. It agreed that the TENERE trials and the MTC showed that there was no difference in effectiveness between teriflunomide and the beta interferons or glatiramer acetate.

4.5, 4.7, 4.8

Evidence for cost effectiveness

Availability and nature of evidence

The manufacturer provided a de novo economic model, which the Committee understood to be structurally similar to models used in previous NICE technology appraisals.

3.32, 4.11

Uncertainties around and plausibility of assumptions and inputs in the economic model

The Committee acknowledged that there were still some uncertainties in the economic analyses relating to whether treatment waning would occur, the amount of non-health costs that should be considered, and the fact that the benefits of oral treatment are not captured in the QALY.

4.18, 4.19, 4.21

The Committee noted the ERG's concern about the external validity of the manufacturer's model, and discussed the external validation presented by the manufacturer in response to the appraisal consultation document. The Committee noted that the incremental cost-effectiveness ratios (ICERs) estimated by the manufacturer's revised model were substantially higher than those in NICE technology appraisal guidance 32 for most of the comparators. The Committee noted the considerable uncertainty in the current analyses, and the analyses carried out for NICE technology appraisal guidance 32, and acknowledged that showing close convergence between the previous and present analyses was challenging. The Committee concluded that the manufacturer's model was sufficiently valid for decision-making in the current appraisal.

4.12

Incorporation of health-related quality-of-life benefits and utility values

Have any potential significant and substantial health-related benefits been identified that were not included in the economic model, and how have they been considered?

The Committee concluded that the quality-of-life benefits of an oral treatment were not fully captured in the QALY.

4.1, 4.21

Are there specific groups of people for whom the technology is particularly cost effective?

No

What are the key drivers of cost effectiveness?

The Committee was aware that the key drivers of the economic model were the choice of comparator, disease progression, the natural history, the rate of transition to secondary progressive multiple sclerosis, and health-related quality of life associated with more severe health states.

4.13, 3.33

Most likely cost-effectiveness estimate (given as an ICER)

The Committee concluded that teriflunomide dominated the beta interferons. For the comparison with glatiramer acetate, the Committee noted the varying ICERs from the different analyses but accounting for the benefits not captured in the QALY, such as the oral administration of teriflunomide, the Committee concluded that, on balance, the most plausible ICER for teriflunomide compared with glatiramer acetate would be below £20,000 per QALY gained.

4.22

Additional factors taken into account

Patient access schemes (PPRS)

The manufacturer of teriflunomide has agreed a patient access scheme with the Department of Health. This is a simple discount scheme, with the discount applied at the point of purchase or invoice. The level of the discount is commercial in confidence.

2.3

End-of-life considerations

Not applicable.

Equalities considerations and social value judgements

No potential equality considerations were raised.