How are you taking part in this consultation?

You will not be able to change how you comment later.

You must be signed in to answer questions

  • Question on Consultation

    Has all of the relevant evidence been taken into account?
  • Question on Consultation

    Are the summaries of clinical and cost effectiveness reasonable interpretations of the evidence?
  • Question on Consultation

    Are the recommendations sound and a suitable basis for guidance to the NHS?
  • Question on Consultation

    Are there any equality issues that need special consideration and are not covered in the medical technology consultation document?
The content on this page is not current guidance and is only for the purposes of the consultation process.

3 Evidence

NICE commissioned an external assessment group (EAG) to review the evidence submitted by the company. This section summarises that review. Full details of all the evidence are in the project documents on the NICE website.

Clinical evidence

The clinical evidence comprises 11 studies, 1 of which is a randomised controlled trial

3.1 The EAG's review included 11 studies: 1 randomised controlled trial, 4 diagnostic studies, 1 cross-sectional design study, 1 case report and 4 publications that included a mix of before-and-after and case-series study design. Six of the studies included a total of 656 people with hip or knee osteoarthritis. Four of the studies included a total of 242 people at risk of falls. One study was done in a healthy population of 136 people with no existing gait problems. For full details of the clinical evidence, see section 3 of the assessment report in the supporting documentation.

Three studies are relevant to the decision problem for people having hip or knee replacement, including the randomised controlled trial

3.2 The study most clinically relevant to people having hip or knee replacements was the unpublished randomised controlled trial (McNamara, unpublished). This compared GaitSmart with standard care for rehabilitation in 44 people who had either had total knee or hip arthroplasty, and who had had a course of physiotherapy but whose rehabilitation goals had not been met. There was also:

  • a cross-sectional study in 74 people who had had or were having a knee replacement, in which outcomes were compared between 4 groups who were each at different timepoints relating to surgery (Rahman, 2015)

  • a case series that reported gait differences in a group of 55 people with hip arthrosis, and included comparisons with a control group of people with no health issues (Hanley, 2016)

  • 3 diagnostic studies in relevant populations, which compared using GaitSmart with optical tracking systems (IMI-APPROACH, McCarthy, 2013; Zugner, 2019).

Outcomes from these studies suggested that GaitSmart measurements correlate with other comprehensive gait analysis systems.

Four studies are relevant to the decision problem for people at risk of falls

3.3 The evidence base for people at risk of falls included:

  • a study of 121 people who had had an injurious fall and were in community care (Rodgers, 2020)

  • a study of 46 people at risk of falls from 2 GP surgeries (Care City Pilot, unpublished)

  • a study of 14 people at risk of falls in community care (Glasgow Falls Clinic Report, unpublished)

  • a case series that reported on how gait parameters in a healthy older population differed from 18 older people with gait and balance issues (Hodgins, 2015).

All the studies were relevant to the decision problem.

There is a high degree of heterogeneity in the evidence, and the lack of long-term studies makes any long-term outcomes uncertain

3.4 There is a high degree of heterogeneity in terms of the comparisons made and outcomes reported in the studies. So, a meta-analysis was not done. The clinical experts noted that the care pathways are extremely variable for people at risk of falls, and for people who have had a hip or knee replacement. This may make it difficult to identify appropriate comparators. The EAG also noted that there was poor reporting of study designs and recruitment methods in the included studies, with incomplete reporting of factors such as participant demographics. There was also a lack of:

  • long-term follow-up in relation to clinical outcomes

  • data on adherence to the intervention protocol

  • data on drop-out rates.

Results from the studies indicate that GaitSmart has the potential to improve gait parameters and patient-reported outcomes

3.5 The published evidence for changes in gait parameters and patient-reported outcomes for GaitSmart was based on comparative studies that included control groups and single-arm studies. The clinical evidence was primarily generated in settings that are generalisable to the NHS. There were strengths in the available studies in that they used validated tools to measure patient-reported outcomes and function. Also, consideration was given to whether observed changes were clinically significant. Based on the limited clinical evidence, the EAG considered that the case for adoption of GaitSmart was potentially supported, but that further evidence generation would be beneficial. It was also noted that the most relevant evidence had not been peer reviewed or published in the public domain.

No adverse events are reported in the literature

3.6 No adverse events were reported in any of the studies relating to GaitSmart or vGym. For full details of the adverse events, see section 3 of the assessment report in the supporting documentation.

Cost evidence

The company's cost model for hip and knee rehabilitation finds GaitSmart to be cost saving compared with standard care

3.7 The company developed a decision-tree model from an NHS perspective with a time horizon of 17 weeks. It compared GaitSmart with self-managed home exercise, or group or individual physiotherapy. It was assumed that 20% of people do self-managed rehabilitation, and 80% have group or individual physiotherapy. Clinical inputs were taken from the unpublished McNamara randomised controlled trial. This included estimates of the response rate of each intervention and the reduction in falls risk. The company's model considered the change in falls risk of each intervention through the observed change in gait speed. It did this using individual-level data from McNamara (unpublished), and a risk ratio between gait speed and falls risk of 1.069/10 cm/s decrease from Verghese (2009). A response rate of 0.79 was assumed for the standard-care arm and of 0.93 for the GaitSmart arm. This rate was defined as any improvement in gait speed. The probability of falls was estimated as 0.4, using the proportion of people who had falls after arthroplasty from Smith (2016) or because of symptomatic osteoarthritis from Doré (2015). The company's base case showed a cost saving of £450.56 per person using GaitSmart. For full details of the cost evidence, see section 4 of the assessment report in the supporting documentation.

The company's cost model for people at risk of falls finds GaitSmart to be cost saving compared with standard care

3.8 The company developed a decision-tree model from an NHS perspective with a time horizon of 1 year, which compared GaitSmart with individual physiotherapy. Clinical inputs were taken from the single-arm Rodgers (2020) study. In the company's model, each intervention was applied only after a fall that had resulted in an injury. People who had an injurious fall, had medical attention through ambulance call-out, a GP visit or attendance at an emergency department. The model used the probability of falls among community-dwelling adults over 65 and the average probability of recurrent falls by fear of falling from Berry (2008), Tinetti (1998) and Arfken (1994). The falls risk reduction was assumed to be 0% with standard care and 1.77% with GaitSmart. The response rate of each intervention was not considered in the company's model. The company's base case showed a cost saving of £2.90 per person using GaitSmart. For full details of the cost evidence, see section 4 of the assessment report in the supporting documentation

The company's cost model for people having hip or knee replacements is appropriate, but there are some EAG changes to model parameters

3.9 The EAG did not agree with the company's calculation of the response rate for each intervention in the rehabilitation model. In the EAG's model, the falls risk ratio for each intervention was calculated using the approach detailed in Verghese (2009). This study specified that there was a change in the falls risk of 1.069/10 cm/s decrease in gait speed. The risk ratio was then applied to the baseline falls probability to yield the falls probability of each intervention. The EAG also separated the falls risk ratio for people who did or did not have a response to the intervention in the rehabilitation model. The EAG used updated Personal Social Services Research Unit cost data and inflated it for 2021/2022. This increased the total cost for all GaitSmart sessions per patient from £67.00 to £82.00. The total cost for all group or individual physiotherapy sessions per patient was calculated by the EAG to be £198.44 rather than £643.98. This decrease was primarily because consultant time was excluded.

The company's cost model for people at risk of falls is appropriate, but there are EAG changes to the model structure and parameters

3.10 The EAG stated that the company's falls model was flawed because of the time point when the intervention was provided. It meant that each intervention was applied only after an injurious fall. The company's model did not model further outcomes after an intervention was given for people who had an injurious fall. The EAG's falls model starts with people having either GaitSmart or standard care. At the end of each branch, people had either falls or no falls. The falls outcomes were modelled following a fall. The EAG was concerned that the probability of falls needing medical treatment in the company's model was taken from an Australian study, Watson (2011), which may not be generalisable to the NHS setting. In the EAG's model, the probability of injurious falls and medical treatment after a fall were taken from Craig (2013). This was used to populate the return on investment tool developed by Public Health England for falls prevention programmes for older people in the community. The EAG increased the total cost for all GaitSmart sessions per patient from £40.00 to £82.00. This included the total staff costs for the intervention. The total cost for standard care was calculated by the EAG to be £102.71 rather than £765.00. This large decrease was primarily because the number of physiotherapy sessions was reduced from 30 to 8. Also, sessions after the initial appointment were assumed to be group rather than individual physiotherapy. The EAG made small changes to the cost of events after a fall, which were:

  • GP visit: from £36 to £42

  • ambulance call-out: from £257 to £282

  • emergency department visit with no admission: from £166 to £118

  • inpatient stay: from £1,609 to £1,950.

GaitSmart is still cost saving compared with standard care in the EAG's base-case models

3.11 When using the EAG's base-case model for rehabilitation, GaitSmart remained cost saving by £80.39 per person compared with standard care. The EAG did a series of one-way sensitivity analyses for several key parameters. GaitSmart was found to be cost saving across the range of results for each parameter. One EAG scenario substituted a band 6 physiotherapist for a band 4 therapy assistant for physiotherapy sessions in standard care. This yielded a change in the cost saving from £80.39 to £24.45. Combining this scenario with an increase in the proportion of people having group physiotherapy sessions (from 50% to 75%) resulted in incurred costs of £17.32. In the EAG's base-case model for people at risk of falls, GaitSmart remained cost saving by £28.70 compared with individual physiotherapy. In the sensitivity analysis, the EAG selected a variety of comparator options. All included an initial 45‑minute assessment by a band 5 physiotherapist, followed by a variety of group or 1:1 interventions. The sensitivity analysis also used a risk ratio ranging from 0.5 (50% reduction in falls) to 1 (no reduction in falls) to 1.5 (50% increase in falls). A two-way analysis was done to identify the point of cost neutrality when factoring in the risk ratio for standard care. Cost neutrality is likely to lie between £70.00 and £110.00 per person for standard care, in which GaitSmart costs £82.00 per person to deliver.

Costs of GaitSmart and standard care are the key cost drivers in the economic models

3.12 For the falls model, 70% of the base-case cost difference was because of the relative costs of the interventions. So, by far the most important economic input to the model is the cost of the comparator. For GaitSmart to be cost neutral or cost saving, the cost of comparator must be very close to the cost of GaitSmart. Falls can have a significant impact on people who have them and on the NHS. But GaitSmart results in a relatively small reduction in the number of falls (11%) in the model, so the modelled impact of falls on cost saving is small. In the rehabilitation model, overall cost saving was also dominated by the cost difference between interventions, while a marginal number of falls were prevented by GaitSmart. The impact of falls in the model was limited by the short duration.