3 Committee discussion

The appraisal committee considered evidence submitted by Bristol–Myers Squibb and a review of this submission by the evidence review group (ERG), and the technical report developed through engagement with stakeholders. See the committee papers for full details of the evidence.

This review looks at data collected after time in the Cancer Drugs Fund to address uncertainties identified during the original appraisal. Further information about the original appraisal can be found in the committee papers. As a condition of the Cancer Drugs Fund funding and the managed access arrangement, the company was required to collect updated efficacy data from the CheckMate 057 study. In addition, data were collected on nivolumab for people with PD‑L1-positive disease in the NHS through the Cancer Drugs Fund using the Systemic Anti-Cancer Therapy (SACT) dataset.

The committee recognised that there were remaining areas of uncertainty in the analyses presented (see technical report, table 3, page 23) and took these into account in its decision making. The committee discussed the following issues, which were outstanding after the technical engagement stage:

  • the appropriate comparator

  • parametric models to predict overall survival and progression-free survival

  • utility values

  • the 2-year stopping rule for nivolumab and the continued duration of treatment benefit if nivolumab is stopped at 2 years.

Clinical need

People with previously treated advanced NSCLC with PD-L1-positive tumours value nivolumab as a treatment

3.1 Non-squamous non-small-cell lung cancer (NSCLC) is often diagnosed late in life and causes debilitating and distressing symptoms. The clinical expert submission explained that overall survival for lung cancer in the UK is poor, but the introduction of immunotherapies such as nivolumab means people can live longer. The committee was aware that patients and professionals want treatments that are effective, minimally disruptive, and improve quality of life. It noted that some patients had experienced anxiety and distress because of the 2-year stopping rule used in the original guidance. This was because they did not want to stop benefitting from treatment. The clinical expert submission suggested that in clinical practice nivolumab would be used when people had not had a previous PD-1 or PD-L1 inhibitor. The committee concluded that people with locally advanced or metastatic non-squamous NSCLC with PD-L1-positive tumours would value nivolumab as a treatment option.

Docetaxel alone is the most appropriate comparator

3.2 In the original appraisal, docetaxel monotherapy, nintedanib plus docetaxel for people with adenocarcinoma and best supportive care were considered relevant comparators. The committee was aware that since its publication, pembrolizumab and atezolizumab have been recommended for previously treated locally advanced or metastatic NSCLC (see NICE's technology appraisal guidance on atezolizumab for treating locally advanced or metastatic NSCLC after chemotherapy and pembrolizumab for treating PD-L1-positive NSCLC after chemotherapy). There have also been changes to treatment options for untreated disease (see NICE's technology appraisal guidance on pembrolizumab for untreated PD-L1-positive metastatic NSCLC and pembrolizumab with pemetrexed and platinum chemotherapy for untreated, metastatic, non-squamous NSCLC). The Cancer Drugs Fund clinical lead from NHS England confirmed that the treatment pathway had changed and because immunotherapies were now available for untreated disease, nivolumab was not used as often for previously treated disease. In line with NICE's methods guide for technology appraisals, the original scope was not changed for this Cancer Drugs Fund review. This meant that pembrolizumab and atezolizumab could not be considered comparators because they were recommended after the original guidance was published. The company only submitted cost-effectiveness analyses comparing nivolumab with docetaxel alone because it stated that neither best supportive care nor nintedanib and docetaxel are commonly used in clinical practice. Clinical advice to the ERG also suggested that nintedanib plus docetaxel is not commonly used to treat non-squamous NSCLC, and at technical engagement, a professional organisation advised that less than 5% of people have this combination. Furthermore, the Cancer Drugs Fund clinical lead explained that nintedanib plus docetaxel is not commonly used because it is associated with a wide range of side effects. The committee was concerned that the company had not presented cost-effectiveness estimates comparing nivolumab with nintedanib plus docetaxel, which was considered a relevant comparator in the original appraisal. However, it understood that this was because changes to the treatment pathway after publication of the original appraisal mean it is now very unlikely to be used in clinical practice in the NHS in England. The committee agreed that best supportive care was also very unlikely to be used after chemotherapy. It concluded that docetaxel alone was the most appropriate comparator for this Cancer Drugs Fund review.

Clinical effectiveness

Nivolumab is clinically effective compared with docetaxel alone for people with PD-L1-positive non-squamous NSCLC after chemotherapy

3.3 As well as new data from the CheckMate 057 and CheckMate 003 studies, there were new SACT data available for this review. This was collected from 43 people who had nivolumab in the Cancer Drugs Fund between September 2017 and December 2018. CheckMate 057 is an open-label trial that included 582 adults with non-squamous NSCLC, whose disease had progressed after previous platinum-based chemotherapy and who had not previously had a PD-1 or PD-L1 inhibitor. Patients were randomised to have either nivolumab (3 mg per kg, the recommended dose in the summary of product characteristics at the time) or docetaxel. There were 122 patients with PD-L1-positive disease (PD-L1 on at least 1% of tumour cells) in the nivolumab arm and 123 patients with PD-L1-positive disease in the docetaxel arm. For the PD-L1-positive subgroup, the hazard ratio using 5‑year data from CheckMate 057 showed nivolumab was associated with a statistically significant improvement in overall survival compared with docetaxel (the exact data are confidential and cannot be reported here). The committee understood that 1‑year overall survival reported in the SACT data (43%, 95% confidence interval: 28% to 58%) was considerably lower than that in the nivolumab arm of the trial (for which the exact data are confidential and cannot be reported here). However, the SACT data were limited by their small sample size and short follow up. The committee agreed that data from the CheckMate 057 trial were the most robust and were suitable for assessing the clinical effectiveness of nivolumab. It concluded that nivolumab was clinically effective compared with docetaxel alone for people with PD‑L1-positive non-squamous NSCLC after chemotherapy.

Dose of nivolumab

The new dosage for nivolumab was not used in CheckMate 057 but is unlikely to have a large effect on the clinical and cost-effectiveness results

3.4 At the time of the original appraisal the recommended dose of nivolumab in its summary of product characteristics was 3 mg per kg every 2 weeks. This has since changed to 240 mg every 2 weeks. The company assumed that the new dose has the same clinical effectiveness as the previously recommended dose. The committee understood that there were no clinical-effectiveness data using the new dosage. The Cancer Drugs Fund clinical lead advised that the dose change for nivolumab was not considered important because it had been accepted by the regulatory body and was already being used in clinical practice in the NHS. The committee concluded that although it had not seen clinical-effectiveness evidence for the new dosage, it was unlikely to have a large effect on the clinical and cost effectiveness of nivolumab.

Economic model

The company's economic model is suitable for decision making

3.5 The company's updated model used the same approach as the original appraisal. The model had 3 health states: progression-free disease, progressed disease and death. Health-state occupancy over time was informed by survival curves from CheckMate 057, but the committee only considered data for the relevant subgroup (PD-L1 of at least 1%). The company modelled nivolumab using clinical-effectiveness data for the 3 mg per kg dose but applied the costs of 240 mg every 2 weeks, and the committee considered this approach appropriate. It concluded that the company's model was suitable for decision making.

Modelling overall survival and progression-free survival

The company's spline 1-knot model for progression-free survival is appropriate

3.6 The company fitted several models to the updated 5‑year progression-free survival data from CheckMate 057 for both treatment arms. It preferred the spline 1‑knot normal curve for its base-case analysis. The ERG considered the company's model to be a good fit to the observed Kaplan−Meier data. The committee concluded that the company's spline 1‑knot normal model was appropriate.

The company's log-normal model for overall survival and scenario analysis using a spline 3-knot model for nivolumab are both plausible

3.7 The company also fitted several models to the updated 5‑year overall survival data from CheckMate 057 for both treatment arms. It preferred the log-normal curve for its base-case analysis. The company explained that the log-normal curve was selected based on statistical fit to the trial data, but it did not provide a good visual fit to the middle or tail of the observed data for the nivolumab arm. The company reasoned that this could underestimate long-term survival and so provided a scenario analysis using a spline 3‑knot hazard curve to model survival for the nivolumab arm. The ERG suggested that the spline 3‑knot hazard model gave a better visual fit to the data, but because the CheckMate 057 data were mature the choice between alternative plausible distributions was unlikely to have a large effect on the cost-effectiveness results. The committee considered the company's models for overall survival. It accepted that for nivolumab, the spline 3‑knot hazard curve gave a slightly better visual fit to the observed Kaplan−Meier data than the log-normal curve, but noted that both curve fits were similar. Using the spline 3‑knot hazard curve to model overall survival for nivolumab improved its cost-effectiveness results. The committee concluded that the company's base-case log-normal model for overall survival, and scenario analysis using a spline 3‑knot hazard model for nivolumab, were both clinically plausible.

Stopping rule and continued treatment effect

It is likely that nivolumab's survival benefit continues after it is stopped

3.8 The company asserted that people who had nivolumab would continue to accumulate further survival benefit after nivolumab was stopped. In response to technical engagement, 1 professional organisation considered it clinically plausible that nivolumab could 'reset' the immune system and that its benefit could last for years after it was stopped. The company advised that data from CheckMate 003 showed that, out of 16 people who survived for 5 years and had no therapy after stopping nivolumab, 12 (75%) still did not have progressed disease. CheckMate 003 is a single-arm study of 129 patients with squamous or non-squamous NSCLC, of whom 19 had non-squamous NSCLC and had 3 mg per kg of nivolumab. It included people who had between 1 and 5 previous therapies and disease progression after at least 1 platinum or taxane-based chemotherapy, and who stopped nivolumab after 1.8 years. The company also explained that only a small proportion of people were still on treatment with nivolumab after 5 years in CheckMate 057 in the PD‑L1-positive subgroup (the exact data are confidential and cannot be reported here). However, an overall survival benefit was seen compared with docetaxel (see section 3.3). The Cancer Drugs Fund clinical lead agreed that the long-term data from CheckMate 003 and CheckMate 057 suggested a continued survival benefit after treatment was stopped. Data from CheckMate 003 were limited because:

  • it included a mixed population and only 19 people had non-squamous NSCLC and had the recommended 3 mg per kg dose of nivolumab

  • after 4 years, the number of patients that remained in the trial was too small to detect the risk of an event

  • the results were not specific to people with PD-L1-positive disease.

    The committee recognised the limitations of CheckMate 003, but accepted that it was biologically plausible that nivolumab's survival benefit continued after treatment was stopped. It concluded that nivolumab is likely to provide a continued survival benefit after it is stopped.

The 2-year stopping rule for nivolumab is appropriate

3.9 The company preferred to include a 2‑year stopping rule for nivolumab. The ERG explained that there was no robust evidence to show the optimal duration of treatment. The company did not submit any data from CheckMate 153, an ongoing study investigating the effect of a maximum of 1‑year treatment with nivolumab. The committee understood that the summary of product characteristics approved nivolumab to be used as long as clinical benefit was observed or until treatment was no longer tolerated, and that no stopping rule was used in CheckMate 057. It agreed that there was uncertainty about how long people should have nivolumab for, based on the updated CheckMate 057 and 003 data. The Cancer Drugs Fund clinical lead explained that a 2‑year stopping rule for immunotherapies such as nivolumab was commonly used in clinical practice in the NHS. Some patients experienced anxiety and distress because of having treatment stopped at 2 years (see section 3.1). At the committee meeting, the company suggested that this was not the experience of all patients and some might welcome a break from treatment. The committee was aware that removing the 2‑year stopping rule had a large effect on the cost-effectiveness results. It concluded that a 2‑year stopping rule for nivolumab was appropriate because it is likely there is a continued survival benefit. Also, there was no new evidence to show that continuing treatment for longer gave additional benefit.

When nivolumab is stopped at 2 years, it is acceptable to assume an additional survival benefit for at least 3 more years

3.10 In its base-case analysis, the company preferred to assume that if nivolumab is stopped at 2 years, it will provide a lasting, lifetime survival benefit. The ERG reiterated that the duration of any continued treatment effect is unknown. The company agreed that this is uncertain. It provided 2‑way sensitivity analyses increasing the duration of additional benefit and the proportion of patients who experience it. Evidence from CheckMate 003 showed a continued survival benefit after stopping nivolumab, so the committee considered it clinically plausible that benefit could last for years after it was stopped (see section 3.8 and section 3.9). However, it was not convinced that the company's preferred lifetime survival benefit was plausible. Also, it had not seen evidence to favour any of the company's 2‑way sensitivity analyses. The committee was aware that in the original guidance a 3‑year continued benefit after stopping nivolumab was accepted. It recognised that 5‑year data were now available from CheckMate 057, but there was no new robust evidence on the overall duration of the continued benefit. So, the assumption accepted in the original guidance had not changed. The committee concluded that the exact duration of treatment benefit was unclear, but it was likely to be at least 3 years after treatment had stopped.

Health-related quality of life

A post-progression utility value of 0.569 is appropriate

3.11 The company's base-case analysis used a post-progression utility value of 0.688, based on the updated 5‑year EQ‑5D data from CheckMate 057. However, the committee understood that a decline in the EQ‑5D completion rate meant that post-progression values may be influenced by selection bias. This is because it is likely that responses were increasingly provided by relatively healthy patients in the trial. In the original guidance, the committee's preferred post-progression utility value (0.569) was based on the midpoint between 0.480 (based on van den Hout, 2006, a Dutch study of people having palliative radiotherapy for NSCLC) and 0.657 (based on 3‑year EQ‑5D data from CheckMate 057 with a disutility for end-of-life care applied). The committee was aware that the post-progression values used in technology appraisals for NSCLC were based on time to end of life, with values declining from 0.68 to 0.32 in NICE's technology appraisal guidance for pembrolizumab for treating PD-L1-positive NSCLC after chemotherapy, and from 0.68 to 0.35 in NICE's technology appraisal guidance on atezolizumab for treating locally advanced or metastatic NSCLC after chemotherapy. The company advised that NHS practice has moved on since the van den Hout study, giving better quality of life. The committee considered that the updated utility values from CheckMate 057 would still be influenced by the same selection bias as in the original data. It also agreed that while NHS practice has moved on since 2006, the midpoint value of 0.569 is higher than the van den Hout study's 0.480. Also, the relevant patients still have advanced or metastatic NSCLC at the end of life. The committee agreed that it had not heard any robust evidence to change the assumption accepted in the original guidance. Therefore, it concluded that it was appropriate to use the 0.569 utility value for progressed disease from the original appraisal.

End of life

Nivolumab meets the end of life criteria

3.12 The committee considered the advice about life-extending treatments for people with a short life expectancy in NICE's guide to the methods of technology appraisal. In the original appraisal, the data showed that life expectancy for people with PD-L1-positive NSCLC was less than 24 months and that nivolumab extended life by at least 3 months. The committee did not hear any robust evidence to change this conclusion. Therefore, it concluded that nivolumab met the end of life criteria and could be considered a life-extending treatment at the end of life.

Cost effectiveness

The most plausible ICER is within what NICE considers an acceptable use of NHS resources

3.13 The company's preferred incremental cost-effectiveness ratio (ICER) compared with docetaxel alone for people with PD‑L-positive non-squamous NSCLC was £33,191 per quality-adjusted life year (QALY) gained. No cost-effectiveness results were reported that compared nivolumab with nintedanib plus docetaxel. The comparison of nivolumab and docetaxel included a 2‑year stopping rule for nivolumab, but did not include the committee's other preferred assumptions of:

  • a spline 3‑knot hazard as a plausible alternative curve to model overall survival (see section 3.7)

  • a continued survival benefit of 3 years after nivolumab is stopped at 2 years (see section 3.10)

  • a post-progression utility value of 0.569 (see section 3.11).

    Using its preferred assumptions, the committee noted that the most plausible ICER was between £44,169 (spline 3‑knot hazard curve) and £44,547 (log-normal curve) per QALY gained. It concluded that this was within the range that NICE considers a cost-effective use of NHS resources.

Other factors

3.14 No equality or social value judgement issues were identified.

Conclusion