3 Clinical evidence

3.1 The key clinical outcomes for HeartFlow FFRCT presented in the decision problem were:

  • measures of diagnostic accuracy (sensitivity and specificity, positive and negative likelihood ratios, area-under curve) using invasive fractional flow reserve (FFR) as the reference standard

  • rates of diagnostic coronary angiography, percutaneous coronary intervention and coronary artery bypass surgery

  • adverse events (test-related, major adverse cardiac events, radiation exposure and so on)

  • quality of life

  • mortality.

Summary of diagnostic accuracy evidence

3.2 The company conducted a literature search on the diagnostic accuracy of FFRCT and the existing tests in the current treatment pathway for patients with a 10% to 90% pre-test likelihood of coronary artery disease, against a reference standard of invasive FFR testing. This review identified 5 relevant meta-analysis studies and 23 individual studies, 1 of which was unpublished. Based on the 22 published studies, and using FFR as the reference standard, the company presented diagnostic accuracy per-patient results for HeartFlow FFRCT compared with:

  • invasive coronary angiography (ICA)

  • single-photon emission CT (SPECT)

  • stress echocardiogram (ECHO)

  • magnetic resonance imaging (MRI)

  • coronary CT angiography (CCTA).

    If there were multiple studies for a test, the company conducted a meta-analysis; for example, 3 studies were included in the meta-analysis for HeartFlow FFRCT (Koo et al. 2011, Min et al. 2012 and Nørgaard et al. 2014). The methodology and results of the meta-analyses are reported as academic in confidence.

3.3 The external assessment centre (EAC) reviewed the company's selection of studies and considered that although they addressed the scope in terms of the comparators, reference test and outcomes, most included a mixture of patients with both high (over 90%) and intermediate (10% to 90%) pre-test likelihoods of disease. It also disagreed with the company's decision only to include studies that provided FFR measurements in more than 75% of blood vessels. The EAC considered this criterion not to be reflective of clinical practice, where visual assessment is sometimes used before proceeding with FFR measurements. The EAC also noted that this criterion did not reflect the company's proposed changes to the clinical pathway, where CCTA would be used to decide if HeartFlow FFRCT should be used.

3.4 To address these concerns, the EAC conducted a diagnostic literature search using extra keywords related to comparators and outcomes. It included only studies in which most patients had an intermediate pre-test likelihood of disease. The EAC identified 7 diagnostic studies, including 3 presented by the company (Bernhardt et al. 2012, Nørgaard et al. 2014 and Stuijfzand et al. 2014) and 3 that the company had identified but excluded (Danad et al. 2013, Kajander et al. 2010 and Ponte et al. 2014). Only 1 of these, Nørgaard et al. 2014, involved HeartFlow FFRCT.

3.5 Nørgaard et al. (2014) reported on a multicentre study (the NXT trial) involving 2 UK centres, which compared HeartFlow FFRCT (v1.4) with CCTA for diagnosing myocardial ischaemia in 254 patients with suspected stable coronary artery disease scheduled to have ICA. Most patients in the study (87%) were considered to have an intermediate likelihood of coronary artery disease. Invasive FFR was measured in all vessels (n=484). The study reported the diagnostic performance of HeartFlow FFRCT and CCTA for diagnosing ischaemia compared with FFR measured during ICA as the reference standard. The diagnostic accuracy of each test was presented on a per-patient and a per-vessel basis compared with the reference standard, an FFR value of ≤0.80. Per-vessel FFRCT was correlated to FFR (Pearson's correlation coefficient 0.82, p>0.001), with a slight underestimation of FFRCT compared with FFR. The authors concluded that HeartFlow FFRCT can identify functionally significant coronary artery disease with high sensitivity and specificity. Furthermore, adding FFRCT measurements to CCTA led to a marked increase in specificity.

3.6 The EAC identified 6 studies which both used the comparator tests and included patients with an intermediate likelihood of coronary artery disease. Bernhardt et al. (2012) compared the diagnostic performance of 1.5 T and 3 T MRI scanners using FFR as a reference standard in 34 patients with stable angina and suspected or known coronary artery disease. The authors studied an intermediate-risk population with a mean PROCAM score of 42.7 (a risk assessment metric which estimates the 10‑year risk of developing a coronary event). Ponte et al. (2014) compared the diagnostic accuracy of CCTA and MRI for detecting functionally significant coronary artery disease in patients referred with suspected coronary artery disease, using ICA with FFR as the reference standard. The study included 95 patients with a 15% to 85% pre-test likelihood of coronary artery disease. Stuijfzand et al. (2014) evaluated CCTA and transluminal attenuation gradient compared with CCTA alone for diagnosing functionally significant lesions, using invasive FFR as the reference standard. The study included 85 patients (253 vessels) with an intermediate likelihood of coronary artery disease. Neglia et al. (2015) assessed the accuracy of several imaging techniques – CCTA, SPECT and ECHO – in 475 patients with an intermediate likelihood of coronary artery disease. Danad et al. (2013) evaluated the diagnostic accuracy of CCTA in 120 patients with suspected coronary artery disease who had cardiac positron emission topography (PET), CCTA and ICA. CCTA was done using a hybrid PET/CT scanner. Kajander et al. (2010) evaluated the diagnostic accuracy of PET and CCTA in 107 patients with a history of stable chest pain and a 30% to 70% pre-test likelihood of coronary artery disease. All patients had ICA independently of the non-invasive imaging results, and treatment decisions were based on both ICA and FFR.

3.7 Table 1 summarises the EAC's analysis of diagnostic accuracy for HeartFlow FFRCT and its comparators at both per-vessel and per-patient levels, as shown in table 1. When there was more than 1 diagnostic accuracy study available, the EAC conducted a meta-analysis.

Table 1 Diagnostic accuracy: HeartFlow FFRCT and comparator tests

Type of analysis

Index test

N

Sensitivity

(95% CI)

Specificity

(95% CI)

Positive likelihood ratio

(95% CI)

Negative likelihood ratio

(95% CI)

Patient based

HeartFlow 
FFR
CT

(Nørgaard, 2014: NXT trial)

254

0.86

0.77 to 0.93

0.79

0.72 to 0.85

4.07

3.02 to 5.49

0.18

0.10 to 0.31

Patient based

CCTA

(6 studies)

1,136

0.95

0.92 to 0.97

0.68

0.65 to 0.71

3.18

1.56 to 6.47

0.09

0.05 to 0.16

Patient based

ECHO

(Neglia, 2015)

261

0.45

0.33 to 0.57

0.90

0.85 to 0.94

4.52

2.74 to 7.45

0.61

0.49 to 0.76

Patient based

ICA

(Nørgaard, 2014)

254

0.64

0.52 to 0.74

0.83

0.76 to 0.88

3.70

2.57 to 5.33

0.44

0.33 to 0.59

Patient based

MRI

(2 studies)

129

0.89

0.78 to 0.95

0.91

0.82 to 0.97

8.59

4.12 to 17.9

0.13

0.07 to 0.26

Patient based

SPECT

(Neglia, 2015)

293

0.73

0.63 to 0.81

0.67

0.60 to 0.74

2.20

1.74 to 2.79

0.41

0.29 to 0.57

Vessel based

HeartFlow
FFR
CT

(Nørgaard, 2014)

484

0.84

0.76 to 0.91

0.86

0.82 to 0.89

5.97

4.60 to 7.75

0.18

0.12 to 0.29

Vessel based

CCTA

(4 studies)

1,645

0.85

0.81 to 0.89

0.75

0.73 to 0.77

4.15

2.38 to 7.23

0.19

0.12 to 0.32

Vessel based

ICA

(Nørgaard, 2014)

484

0.55

0.45 to 0.65

0.90

0.87 to 0.93

5.56

3.92 to 7.89

0.50

0.40 to 0.62

Vessel based

MRI

(Bernhardt, 2012)

102

0.87

0.72 to 0.96

0.98

0.92 to 1.00

55.6

7.92 to 390

0.13

0.06 to 0.30

Abbreviations: CCTA, coronary CT angiography; CI, confidence interval; ECHO, stress echocardiogram; FFRCT, fractional flow reserve CT; ICA, invasive coronary angiography; MRI, magnetic resonance imaging; SPECT, single-photon emission CT.

3.8 The EAC considered that despite the limitations associated with patients having a different reference test in some studies, all contributed to the decision problem and provided data for synthesis. It judged that the Nørgaard (2014) study had a low risk of bias for flow and timing, index and reference test. It noted that there was a risk of patient selection bias because an inclusion criterion was that patients had to have been referred for ICA, but it noted no other risks of bias or applicability concerns. Although it acknowledged that there were no studies directly comparing all the tests, it concluded that HeartFlow FFRCT has:

  • similar sensitivity but higher specificity compared with CCTA

  • higher sensitivity but lower specificity compared with ECHO

  • similar sensitivity but lower specificity compared with MRI

  • higher sensitivity and specificity compared with SPECT.

Summary of clinical-effectiveness evidence

3.9 The company conducted a literature search for evidence on the clinical outcomes specified in the decision problem for HeartFlow FFRCT, and the existing treatments, against any comparator. It identified 16 studies of which 5 included HeartFlow FFRCT, 1 published (Guar et al. 2014) and 4 unpublished (PLATFORM, Radiation FFRCT, Real World Usage FFRCT and FFRCT RIPCORD).

3.10 The EAC included extra intervention and comparator keywords and identified 11 studies, 4 of which had already been identified by the company: 2 published studies (Hachamovitch et al. 2012 and Douglas et al. 2015) and 2 unpublished studies. The EAC noted that only the 2 unpublished studies fully matched the population, intervention, comparators and outcomes defined in the scope; the other 9 included various comparators but not HeartFlow FFRCT. The 2 unpublished studies including HeartFlow FFRCT were PLATFORM (see section 3.18) and Radiation FFRCT; the company provided both in the form of interim results for the former and an abstract for the latter. Two studies (Real World Usage FFRCT and FFRCT RIPCORD) included HeartFlow FFRCT but were excluded because they did not provide information on patients' pre-test likelihood of coronary artery disease.

3.11 Radiation FFRCT is a single-centre modelling study, based in Canada, investigating the potential effect of HeartFlow FFRCT on radiation dose exposure and downstream clinical event rate. In the modelling, a clinical pathway in which CCTA plus FFRCT was the initial diagnostic test was compared with 3 clinical pathways instead utilising SPECT, ECHO or CCTA as initial diagnostic tests. The model included 100 patients with suspected coronary artery disease, 34% of whom had intermediate disease. Patients were stratified into 3 categories of likelihood of disease: 50% low, 40% moderate and 10% high. No clinical outcomes were measured in this modelled population. The primary outcome was the estimated radiation dose and the secondary outcome was death or myocardial infarction estimates at 1 year after the test. Of the 4 diagnostic pathways studied, ECHO had the lowest radiation dose (5.3 mSv) but had a higher clinical event rate related to both false-positive and false-negative findings. The FFRCT pathway had lower cumulative radiation exposure (9.4 mSv) than SPECT (26.4 mSv) or CCTA (13.9 mSv) and also had the lowest clinical adverse event rate for low and intermediate-risk patients. For high-risk patients, the lowest clinical event rate was with ICA.

3.12 The PROMISE study (Douglas et al. 2015) is a US‑based multicentre randomised controlled trial involving over 10,000 patients, with a median follow‑up of 25 months. Although the study did not include FFRCT, the EAC considered it relevant to the decision problem because it provides further evidence on a diagnostic pathway based on CCTA. Patients with a mean pre-test likelihood of coronary artery disease of 53.3±21.4% were randomly assigned to either CCTA or functional imaging as a first-line diagnostic test. The composite primary end point was death, myocardial infarction, hospitalisation for unstable angina, or major procedural complication. Secondary end points included invasive cardiac catheterisation that did not show obstructive coronary artery disease and radiation exposure. Results showed that 164 of 4,996 (3.3%) patients in the CCTA group and in 151 of 5,007 (3.0%) in the functional testing group (adjusted hazard ratio, 1.04; 95% confidence interval, 0.83 to 1.29; p=0.75) achieved the primary end point. CCTA was associated with fewer catheterisations showing no obstructive coronary artery disease than functional imaging (3.4% compared with 4.3%, p=0.02), although more patients in the CCTA group had catheterisation within 90 days of randomisation (12.2% compared with 8.1%). The median cumulative radiation exposure per patient was lower in the CCTA group than in the functional testing group (10.0 mSv compared with 11.3 mSv), but 32.6% of the patients in the functional testing group had no exposure. As such, overall exposure was higher in the CCTA group (mean 12.0 mSv compared with 10.1 mSv; p<0.001).

3.13 The EAC identified 9 published studies containing information on clinical outcomes in comparator diagnostic technologies. Further information about these studies can be found in the assessment report.

Committee considerations

3.23 The committee considered that the evidence showed high diagnostic accuracy and increased specificity with HeartFlow FFRCT compared with CCTA alone. It also noted promising results from the PLATFORM study, in a population which closely matches that in the scope. The evidence was sufficient to conclude that HeartFlow FFRCT has a high diagnostic accuracy for coronary artery disease, and that its use has the potential to reduce the need for invasive coronary investigations.

3.24 The committee considered the technology to be innovative and understood that its adoption may serve to simplify a complex patient pathway. The committee heard from clinical experts that they had confidence in the diagnostic accuracy of HeartFlow FFRCT, and that it could provide an effective early rule-out test for coronary artery disease. This would reduce the need for ICA and invasive FFR measurement, and potentially reduce radiation exposure.

3.25 The committee understood that there are differences in the local implementation of the patient pathway for diagnosing coronary artery disease. It was advised by clinical experts that the choice of functional imaging test depends on local access, available expertise and clinician preference. It heard that although HeartFlow FFRCT has the potential to reduce the number of tests that are done, the other non-invasive functional imaging tests that are part of the current patient pathway offer different functionality and in some cases provide additional information. Overall, the committee concluded that HeartFlow FFRCT should be considered for use as a non-invasive investigation for diagnosing angina in patients with stable, recent-onset chest pain of suspected cardiac origin, and that it provides the clinician with additional functional information to determine which coronary lesions are responsible for myocardial ischaemia. The committee considered that further clinical studies would be helpful to clarify the wider applicability of HeartFlow FFRCT in routine clinical practice.

3.26 The committee considered the evidence from the PLATFORM study to be most relevant to the decision problem. It considered that the results demonstrate the potential of FFRCT to avoid ICA and improve quality of life.

3.27 The committee discussed the relative importance of a per-patient or a per-vessel diagnosis. It heard from experts that per-patient diagnostic accuracy was more important for initial diagnosis, and that a per-vessel assessment provides additional information to inform patient management. The committee concluded that per-patient level figures were the most reliable and relevant to the diagnosis of coronary artery disease.

  • National Institute for Health and Care Excellence (NICE)