3 Committee discussion

NICE's medical technologies advisory committee considered evidence, from several sources, on digital technologies to provide multidisciplinary weight-management services. This includes an early value assessment (EVA) report by the external assessment group (EAG), and an overview of that report. Full details are in the project documents for this guidance.

Unmet need

3.1

There is an unequal distribution of specialist weight-management services across the NHS, that provide access to weight-management multidisciplinary teams. In some areas there is no access to these services. In areas where there are services, there is an increasing number of people on waiting lists because of limited resources and funding. Also, waiting times for accessing services have been rising significantly. The clinical experts estimated that 30% to 70% of people do not have access to a specialist weight-management service in their area. They also estimated that 10% to 30% of people are unable to attend in-person appointments because of time commitments or for mental health reasons.

3.2

Limited access to multidisciplinary weight-management services (including specialist weight-management services) may also limit access to weight-management medicine for people who are eligible. Weight-management medicines, semaglutide and liraglutide, can only be accessed alongside a programme from a specialist weight-management service. The clinical experts explained that if there are no specialist services available, people may be referred to other services that cannot provide or manage weight-management medicine and do not offer appropriate support for treatment with medicine. The clinical experts also said that people who cannot access services may go to private providers that are not regulated and could be harmful because there is no wrap-around support. The clinical experts agreed that there are limited treatment options for people who cannot access specialist services in their area. The committee concluded that there is an unmet need, and access to specialist weight-management services should be improved.

Technologies for prescribing and monitoring weight-management medicine and delivering multidisciplinary weight-management services

Clinical effectiveness

3.3

The evidence suggests that 5 out of the 8 technologies (Gro Health W8Buddy, Liva, Oviva, Roczen and Second Nature) have a potential benefit for adults who are eligible for treatment with weight-management medicine. But only 1 published full-text study included people who were taking weight-management medicine. There was limited evidence for CheqUp and Juniper and no evidence for Wellbeing Way.

3.4

The evidence base consists of 26 studies reported across 31 publications. Four studies for Second Nature were excluded from the EAG assessment report because they were not considered relevant to the decision problem. But the committee later considered these studies relevant to the assessment. The evidence included 1 randomised controlled trial (RCT), 4 non-randomised comparative studies, 1 pilot RCT (which did not compare the technology with standard care), 13 non-comparative studies and 7 unpublished studies that were provided by the companies. The EAG explained that comparative evidence reported equivalent or more weight loss when using the technologies compared with in-person multidisciplinary weight-management services, but that this evidence is limited. The statistical significance beyond 1 year is uncertain, but the evidence suggests equivalence with standard care at 2 years. The evidence generally reported weight loss for the technologies when compared with baseline (for Liva, Oviva, Roczen and Second Nature). The clinical experts agreed that the non-comparative evidence was enough to demonstrate at least equivalent weight loss when the technologies were compared with having no access to multidisciplinary weight-management services. The committee heard that longer-term follow up is needed because obesity is a chronic condition.

3.5

There is some evidence on programme adherence, programme engagement, health-related quality-of-life outcomes and psychological outcomes. The RCT for Liva reported no difference in the EQ‑5D‑5L or Short Warwick–Edinburgh Mental Wellbeing Scale scores compared with in-person support or with baseline at 6 months and 12 months. The committee concluded that more evidence is needed for these outcomes.

3.6

During consultation, further evidence was submitted for CheqUp, Gro Health W8Buddy, Juniper, Oviva and Second Nature. Gro Health W8Buddy provided an additional poster report on weight loss outcomes and an unpublished paper. The committee concluded that the additional evidence provided was enough to support using Gro Health W8Buddy in the NHS while further evidence is generated. Second Nature provided a conference poster of a retrospective cohort study, and Oviva provided an abstract on adverse event data when using Oviva with weight-management medicine. This conference poster and abstract did not change the outcome of the assessment.

3.7

CheqUp submitted a preliminary data summary of an ongoing study using the technology alongside weight-management medicine. Juniper provided interim results on 2 ongoing studies and details of a third ongoing study. CheqUp and Juniper later submitted further detail. CheqUp provided a non-NHS UK-based unpublished study reporting weight-loss outcomes for people having treatment with weight-management medicine alongside CheqUp. Juniper provided an unpublished study reporting weight-loss outcomes for people having treatment with weight-management medicine alongside Juniper in Australia. The EAG stated that both studies have potential sources of bias because they are unpublished and not peer reviewed. The EAG did not consider the results generalisable to the broader NHS setting. The committee noted that the levels of evidence were equivalent to other technologies recommended for use in the NHS with evidence generation and presented evidence of effect for relevant clinical outcomes. So, it was concluded that the additional evidence was enough to support using CheqUp and Juniper in the NHS while further evidence is generated to prescribe and monitor weight-management medicine and deliver multidisciplinary weight-management services.

Risk management

3.8

Further evidence will be generated while 7 technologies (CheqUp, Gro Health W8Buddy, Juniper, Liva, Oviva, Roczen and Second Nature) are used in the NHS to address the immediate unmet need, with appropriate risk-management processes in place. The clinical experts and committee stressed the importance of clinical risk management. The companies advised that they have risk-management processes and safeguarding systems in place. Most of the technologies have monitoring systems to pick up any key words relating to safety or adverse events, as well as regular contact with healthcare professionals. The committee highlighted that there is a lack of evidence relating to how the technologies monitor and report adverse events, and limited evidence for people taking weight-management medicine. The committee concluded that these technologies can be used, while evidence is generated, as an option to deliver multidisciplinary weight-management services to manage weight-management medicine. But they should only be used with appropriate safeguarding and risk-management processes in place.

3.9

The clinical experts raised that there is limited information on how multidisciplinary teams (MDTs) are used in the programmes offered by the technologies. But they noted that this is also the case for standard care and that MDTs can vary significantly between weight-management services. The clinical experts also highlighted that a full clinical assessment and referral for weight-management medicine is needed before using these technologies, to make sure the technologies are suitable. They also noted that the programmes' MDTs must include, or have access to, psychological support because obesity is a complex condition that requires a lot of support. People may have additional comorbidities and a large proportion of people with obesity have mental health issues. The clinical experts said that it is important to monitor behaviour on restricted diets to minimise the risk of potential harms, such as developing disordered eating. The committee concluded that both psychological monitoring and appropriate referral procedures are important.

Costs and resource use

3.10

The preliminary results of the early economic modelling showed that the technologies are cost effective when compared with in-person services. The EAG said that there was limited data to populate the parameters of the model, and that the results are uncertain. Based on the sensitivity and threshold analysis, the biggest factor affecting the results is the estimate of standard care costs used for current tier 3 services. The threshold analysis showed that if standard care costs were reduced by approximately 25%, or the technology costs were increased by 35%, then standard care would become the cost-effective option. The committee concluded that further evidence on clinical effectiveness including health-related quality of life and resource use is needed to reduce uncertainty in the cost modelling.

Technologies delivering multidisciplinary weight-management services when they are not used to prescribe or monitor weight-management medicine

Clinical effectiveness

3.11

The evidence suggests that 9 technologies (CheqUp, Counterweight, Gro Health W8Buddy, Juniper, Liva, Oviva, Roczen, Second Nature and Weight Loss Clinic) have a potential benefit when delivering multidisciplinary weight-management services without prescribing or monitor weight-management medicine. But, only 4 studies included people in tier 3 or 4 multidisciplinary weight-management services, only 1 study met the decision problem in all areas, and there is an unknown likelihood of crossover between some of the publications. There was limited evidence for Habitual and no evidence for Gloji and Wellbeing Way. The committee concluded that the evidence provided was not of good enough quality to recommend Gloji, Habitual and Wellbeing Way for use in the NHS while further evidence is generated.

3.12

The evidence base consists of 53 published studies for 7 technologies (Oviva [n=20], Counterweight [n=11], Second Nature [n=8], Gro Health W8Buddy, Liva [n=5], Roczen [n=3] and Weight Loss Clinic [n=3]) and 21 unpublished studies for 7 technologies (Liva [n=6], Oviva [n=6], Habitual [n=3], Juniper [n=2], Roczen [n=2], CheqUp [n=1] and GroHealth [n=1]). Published evidence included 4 randomised controlled trials (RCT), 7 non-randomised comparative studies, 1 pilot RCT (which did not compare the technology with standard care), 40 non-comparative studies and 1 study reporting outcomes for Liva, Oviva and Second Nature. The EAG explained that comparative evidence reported equivalent or more weight loss when using the digital technologies compared with in-person services, but that this evidence is limited. The statistical significance beyond 1 year is uncertain, but the evidence suggests equivalence with standard care at 2 years. Non-comparative evidence generally reported weight loss when using the technologies compared with baseline. There was a lack of evidence comparing digital technologies to no treatment. The committee heard that longer-term follow up is needed because obesity is a chronic condition.

3.13

There is some evidence on programme adherence, programme engagement, health-related quality-of-life outcomes and psychological outcomes. An RCT for Counterweight reported an increase in health-related quality of life in the intervention group compared with the control group. The RCT for Liva reported no difference in the EQ‑5D‑5L or Short Warwick–Edinburgh Mental Wellbeing Scale scores compared with in-person support or with baseline at 6 months and 12 months. The committee concluded that more evidence is needed for these outcomes and highlighted the importance of consistency in the patient-reported outcome measures used when collecting psychological outcomes in future research and evidence generation.

3.14

During consultation, further evidence was submitted for CheqUp and Juniper. CheqUp provided a non-NHS UK-based unpublished study reporting weight-loss outcomes for people having treatment with weight-management medicine alongside CheqUp. Juniper provided an unpublished study reporting weight-loss outcomes for people having treatment with weight-management medicine alongside Juniper in Australia. The EAG stated that both studies have potential sources of bias because they are unpublished and not peer reviewed. The EAG did not consider the results generalisable to the broader NHS setting. The committee acknowledged the limitations of the evidence. But, it noted that levels of evidence were equivalent to other technologies recommended for use in the NHS with evidence generation and presented evidence of effect for relevant clinical outcomes. So, the committee concluded that the additional evidence was enough to support using CheqUp and Juniper in the NHS while further evidence is generated, to deliver multidisciplinary weight-management services when they are not used for weight-management medicine prescribing and monitoring.

Risk management

3.15

The clinical experts stated that there is limited information on what the digital multidisciplinary weight-management programmes consist of and how they differ between technologies. But, they noted that this is also the case for standard care and that offerings can vary significantly between in-person services. The clinical experts highlighted the importance of having appropriate qualifications (such as a SCOPE certification) and suitable levels of experience managing obesity. They also noted that the programmes' MDTs should include access to physiotherapy and psychological support because obesity is a complex condition that needs a lot of support. People may have additional comorbidities and a large proportion of people with obesity have mental health issues. The clinical experts said that it is important to monitor behaviour on restricted diets to minimise the risk of potential harms, such as developing disordered eating. The committee concluded that digital multidisciplinary weight-management programmes should be delivered by appropriately qualified and experienced healthcare professionals and must include, or have access to, psychological monitoring.

Monitoring engagement and user experience

3.16

Engagement and adherence should be monitored and followed up throughout the duration of the programme. Clinical experts explained that there is a lack of information about why people stop using digital programmes. The companies explained that engagement is monitored during regular meetings with healthcare professionals. If this drops below a pre-determined threshold, users may be prompted to reengage through automated messages, nudges, peer mentoring or direct contact with a healthcare professional. Some companies also stated that engagement can be tracked automatically through user interaction with app content. The committee concluded that referral procedures are important, and more evidence is needed to establish why people stop taking part in programmes.

3.17

Digital programmes should be personalised and incorporate user feedback. The companies explained that user feedback is continuously sought throughout the programmes. Some companies stated that users are sent feedback questionnaires and suggestions can be incorporated into the programme on a bi-weekly basis. Some companies stated that using digital technologies allows detailed levels of feedback to be collected for each piece of content, which can be amended immediately. The clinical experts highlighted the importance of user feedback and how this can be used to enable individualised care for people with obesity. A patient organisation also highlighted the importance of person-centred care when delivering specialist services. Clinical experts acknowledged that implementing user feedback and improvements may be faster and more consistent with digital technologies compared with in-person services. The committee concluded that collecting feedback to improve user experience and enable individualised care is important when delivering multidisciplinary weight-management services using digital technologies.

Costs and resource use

3.18

The preliminary results of the early economic modelling showed that the technologies are cost saving and cost effective when compared with standard care and a 6‑month delay to standard care. With a 12‑month delay to treatment, or when compared with no treatment, the technologies become cost incurring but increase quality of life. The EAG said that there was uncertainty in both the cost and quality-of-life outcomes because there is limited data and long-term outcomes are not included in the model. The committee concluded that further evidence on clinical effectiveness including health-related quality of life and resource use is needed to reduce uncertainty in the cost modelling.

3.19

The technologies may release NHS resources and increase access to multidisciplinary weight-management services, but more evidence is needed. The clinical experts stated that the implementation of digital technologies in the NHS could impact current NHS staff workload positively or negatively. The companies stated that some of their staff previously worked in the NHS, some have worked privately and some continue to work in the NHS alongside their work with digital technologies. The EAG said that there was a lack of evidence related to the cost of implementing digital technologies alongside current NHS services. The model does not take into account the potential inefficiencies of these 2 services working together to deliver multidisciplinary weight-management services. The committee concluded that further evidence should be collected on the NHS staff time needed to support using the technologies.

Evidence gap review

3.20

For 9 technologies (CheqUp, Counterweight, Gro Health W8Buddy, Juniper, Liva, Oviva, Roczen, Second Nature and Weight Loss Clinic), the committee agreed that the evidence is limited. It agreed that the key evidence gaps relate to study design and duration, population, the technologies, comparator, outcomes and decision modelling. The committee concluded that there is enough evidence of potential benefits from the 9 technologies for them to be used in the NHS while further evidence is generated, once they have Digital Technology Assessment Criteria (DTAC) approval. Evidence generation is needed to address the following key evidence gaps:

  • Study design and duration: there is limited comparative evidence and no long-term evidence beyond 1 year for most of the technologies, apart from a 2‑year study for Liva. The committee and clinical experts highlighted the importance of long-term outcomes to evaluate if weight loss can be maintained.

  • Population:

    • For technologies used to deliver multidisciplinary weight-management services, including prescribing and monitoring weight-management medicine, only 1 published full-text study reported the proportion of people taking weight-management medicine and only 9 unpublished studies reported outcomes in people using semaglutide or liraglutide.

    • For technologies used to deliver multidisciplinary weight-management services when the technologies are not used to prescribe and monitor weight-management medicine, only 4 studies included people in tier 3 or 4 specialist weight-management services and only 1 study met the decision problem in all areas.

    • The clinical experts and committee highlighted the importance of generating evidence in people taking weight-management medicine to ensure that patient safety is monitored appropriately. There is also a lack of evidence for how different populations, including people who are underserved, engage with the technologies, and which groups may benefit the most.

  • Comparator: the number of specialist weight-management service providers and the number of people who use the services in the NHS is not known, with limited data on service delivery and MDT composition. The NHS National Obesity Audit could enable these services to be monitored in the future. The committee concluded that it is important to capture this in further evidence generation because it may also impact the cost-effectiveness results.

  • Outcomes: there is limited evidence reporting several outcomes including health-related quality of life, psychological outcomes, engagement and adherence. For digital technologies that prescribe or monitor weight-management medicine, there is inconsistency in the outcomes reported in the evidence base. The clinical experts highlighted that the evidence base includes self-reported and clinically measured weight-related outcomes, which may introduce bias. The clinical experts agreed that key outcomes should be prioritised to ensure consistency in future evidence generation. The committee highlighted the importance of measuring health-related quality of life and psychological outcomes. It said that patient-reported outcome measures for quality of life (EQ-5D, SF-12, SF-36), anxiety or depression (GAD-7, HADS, PHQ-9), eating disorders (TFEQ-R18, DEBQ), binge eating (BEDS-7, BES) and emotional eating (EEQ) should be considered.

  • Decision modelling: there is a lack of direct economic evaluations related to all the technologies. The committee concluded that more direct data is needed for both digital technologies and standard care to reduce uncertainty in future economic modelling.

3.21

The committee concluded that there was not enough clinical-effectiveness evidence to recommend Gloji, Habitual and Wellbeing Way for use in the NHS, other than as part of a research study. Research should include well-designed and adequately powered studies with appropriate comparators. The key outcomes prioritised by the committee are change in weight, adherence and completion rates, including reasons for stopping a programme, how the technologies monitor and report adverse events, health-related quality-of-life and psychological outcomes, impact on resource use, including the number and type of healthcare appointments, cost of the medicine and NHS staff time needed to support using the digital technologies. Research studies should address the evidence gaps outlined in this guidance to assess the benefit of using these technologies to deliver multidisciplinary weight-management services for adults.

Equality considerations

3.22

The technologies may not be suitable for everyone. The clinical experts estimated that 7% to 30% of people may find digital technologies unsuitable, for example, because of reduced manual dexterity or a learning disability. Some people may be less comfortable or skilled in using digital technologies, or may have limited access to equipment and the internet. Autistic people may also find digital technologies unsuitable or may need additional support. The EAG said that the economic model included costs for a tablet computer and monthly internet access, to reduce the risk of excluding people because of digital inequality. The committee noted that language could also be a barrier to accessing the technologies' programmes. The companies confirmed that most of the technologies offer their programmes in multiple languages. The clinical experts said that there is a lack of evidence available to identify which groups may or may not be able to access the technologies, or who may benefit the most from them. The committee accepted that some people may need additional support or equipment when using the technologies. It concluded that there may be some people who may not benefit from the technologies, but that more data is needed to identify who may benefit or not benefit from digital technologies.