3 Committee discussion
The appraisal committee considered evidence from a number of sources. See the committee papers for full details of the evidence.
Remit and objective of this appraisal
This appraisal is a review of NICE technology appraisal guidance on beta interferons and glatiramer acetate for the treatment of multiple sclerosis
3.1
NICE's original technology appraisal guidance on beta interferons and glatiramer acetate for the treatment of multiple sclerosis concluded that these technologies were more clinically effective than best supportive care, but were not a cost-effective use of NHS resources. The Department of Health then established a Risk Sharing Scheme (RSS), which provided the drugs to patients in the NHS and monitored their effectiveness. The scheme was set up so that if the drugs were less effective than anticipated, the prices would fall and if they were more effective than anticipated, an increase in price would be permitted. Because the RSS has now ended, NICE is again appraising these drugs. All patients with relapsing–remitting or secondary progressive multiple sclerosis with relapses who are able to walk were eligible for treatment under the RSS. The scheme did not include people with clinically isolated syndrome or primary progressive multiple sclerosis. The committee understood that the RSS did not include treatment with Extavia, but noted that it is the same as Betaferon.
This appraisal compares beta interferons and glatiramer acetate with best supportive care
3.2
Since NICE originally appraised these drugs, it has recommended other treatment options for relapsing–remitting multiple sclerosis including alemtuzumab, cladribine, dimethyl fumarate, fingolimod, natalizumab and teriflunomide. The specific subgroup and line of therapy recommended for each treatment is defined in each appraisal. These appraisals generally compared the newer drugs with the older beta interferons and glatiramer acetate, under the assumption that the older drugs were provided to the NHS in a cost-effective way through the RSS. The committee understood that its remit was to revisit the original appraisal, and to compare beta interferons and glatiramer acetate with best supportive care, rather than with the newer drugs.
The condition and current treatment pathway
Multiple sclerosis is a chronic, disabling neurological condition
3.3
The clinical and patient experts stated that multiple sclerosis is a chronic, disabling neurological condition. The patient experts explained that relapsing–remitting multiple sclerosis can limit people's ability to work, and to engage in social and family life. Having a wide range of first-line treatments increases the chance of finding a treatment that works for people with this complex disease, and most try 1 or more of the beta interferons and glatiramer acetate before moving on to other therapies. People whose disease progresses from relapsing–remitting multiple sclerosis to secondary progressive multiple sclerosis, but who continue to have relapses, may continue to have beta interferon. The committee understood that most people have treatment until they can no longer walk, when they stop treatment. The committee also understood from the responses to the appraisal consultation document that the frequency of treatment administration may have an effect on adherence to, and therefore the effectiveness of, treatment.
Clinical effectiveness in clinically isolated syndrome
Clinically isolated syndrome is less relevant than it once was
3.4
A single demyelinating event is known as clinically isolated syndrome, and people experiencing this have a higher chance of developing multiple sclerosis than people who have never had such an event. The committee understood from clinical experts that the diagnostic criteria for multiple sclerosis changed in 2010. The committee was aware that updated diagnostic criteria published in 2017 did not affect the definition of clinically isolated syndrome. Clinically isolated syndrome is less relevant than it once was, and about half of people previously considered to have the condition are now considered to have multiple sclerosis. Increasingly, MRI evidence is used to diagnose multiple sclerosis at an earlier stage, and the updated diagnostic criteria also allows using cerebrospinal fluid in the early diagnoses of multiple sclerosis. The committee agreed that the treatment pathway for clinically isolated syndrome had evolved.
There is insufficient evidence to make any recommendations for clinically isolated syndrome
3.5
The companies did not include clinically isolated syndrome in their meta-analyses, and people with clinically isolated syndrome were not included in the RSS. The assessment group conducted a network meta-analysis for clinically isolated syndrome, which included 5 trials. These used outcome measures based on pre‑2010 diagnostic criteria. The committee agreed that all the treatments delayed time to clinically definite multiple sclerosis compared with placebo as it was defined before 2010. However, the committee understood that many patients in the trials would have been diagnosed and treated for multiple sclerosis rather than clinically isolated syndrome if current diagnostic criteria were used instead. Therefore, the committee was concerned that clinical trials using the pre‑2010 diagnostic criteria for clinically isolated syndrome were no longer relevant to current UK practice. The committee agreed that a post-hoc analysis which re‑identified patients using the 2010 diagnostic criteria showed encouraging results. However, it was concerned that this was based on a single study and had not been validated by any subsequent trials. The committee concluded that there was insufficient evidence using the current diagnostic criteria to make any recommendations for treating clinically isolated syndrome.
Clinical effectiveness in relapsing–remitting multiple sclerosis
Evidence comes from clinical trials and the RSS
3.6
The committee considered evidence from 4 network meta-analyses of clinical trials from:
-
the assessment group
-
Biogen (interferon beta‑1a, Avonex)
-
Merck Serono (interferon beta‑1a, Rebif)
-
Teva (glatiramer acetate, Copaxone).
In addition to the data from clinical trials, the committee also considered data collected from patients participating in the RSS.
Clinical trials
The trials are broadly generalisable but subject to bias
3.7
The committee considered the generalisability of the clinical trials to patients in the NHS. The assessment group stated that the trials involving people with relapsing–remitting multiple sclerosis had limitations including differences in design and short length of follow‑up. This meant they were at risk of bias because injection-site reactions could have meant that patients in the trials were not blinded to their treatment. The clinical experts stated that unblinding was unlikely to have biased the results for disability progression, which was assessed by investigators blinded to treatment allocation. It concluded that the trials were broadly generalisable and relevant for this appraisal.
Disability progression outcome measure
Trial data for confirmed disability progression sustained for 6 months is preferable
3.8
The committee discussed whether disability progression sustained for 3 months or for 6 months best reflected disability progression in people with relapsing–remitting multiple sclerosis. It recognised that some trials provided both 3- and 6‑month data, and that all trials reported 3‑month data. It was aware that, in previous appraisals, the committee preferred to use confirmed disability progression for 6 months. The clinical experts explained that the time taken to recover from a relapse can vary and that people may still continue to recover after 3 months. The committee agreed that the outcome for confirmed disability progression sustained for 6 months was better at capturing the benefits of treatment. The assessment group stated that it preferred to use confirmed progression at 3 months because the quality and size of its evidence network at this time point was better than that for a confirmed progression at 6 months. The committee concluded that it preferred 6‑month data where available, but that it was important to use a consistent measure across all treatments.
Risk Sharing Scheme
Waning of treatment efficacy
Efficacy does not remain constant over time
3.16
The committee discussed whether the effectiveness of beta interferons and glatiramer acetate was likely to remain constant or wane over time. The clinical experts stated that most treatments for multiple sclerosis become less effective over time, either because the person's immune system develops neutralising antibodies or because the disease worsens and becomes resistant to treatment. The Department of Health stated that, in the RSS, the effect of the treatments waned after the first 2 years. The committee concluded that, for decision-making, it was appropriate to assume that efficacy does not remain constant over time.
Cost effectiveness in relapsing–remitting multiple sclerosis
Natural history of the disease in subgroup analyses
Time horizon and waning of treatment effect
The approach to waning of effectiveness over time differs from previous appraisals
3.19
The assessment group, the Department of Health and the companies chose a time horizon of 50 years for their base-case analyses. The committee agreed that this was long enough to reflect a lifetime horizon, but noted the uncertainties about extrapolating over a lifetime. It also noted that the RSS had a follow‑up period of 10 years and that no treatment waning assumption was needed for this period because it was captured within the treatment effectiveness data. In addition, it noted that, to extrapolate the waning effect over the treatment lifetime, the RSS model applied a 50% reduction in effect after 10 years. NICE's previous technology appraisals (such as alemtuzumab and dimethyl fumarate) assumed a reduction in treatment effect of 25% after 2 years, and of 50% after 5 years. The committee considered that it was appropriate to use a different assumption for the waning effect in this appraisal because the RSS provided longer follow‑up data than the trials in the previous appraisals. It noted that the same reduction in waning effect was applied at the end of the 10‑year follow‑up period as in the previous appraisals. The committee concluded that assuming a 50% reduction in effect after 10 years was appropriate.
Mortality
The standardised mortality ratios in Pokorski et al. (1997) overestimate mortality risk in patients with multiple sclerosis
3.21
An alternative approach to modelling mortality was suggested by Merck Serono, which was based on an assumption that had been used in several previous NICE appraisals (alemtuzumab, fingolimod and teriflunomide). This approach applied mortality ratios from Pokorski et al. to each EDSS health state, which resulted in a greater risk of mortality in people with multiple sclerosis than modelled in both the original RSS approach and the assessment group's approach. The committee was concerned that this overestimated mortality, particularly for lower EDSS states, because it was based on outdated data from a period before there had been improvements in multiple sclerosis care and when the background mortality rate was higher. It was also concerned that, in the Pokorski et al. study, EDSS was measured only at the first clinical visit but that the actual EDSS score at time of death depended on the speed of EDSS progression. The committee agreed that the approach using the mortality ratios from Pokorski et al. had limitations and overestimated mortality.
The standardised mortality ratio reported in Jick et al. (2014) overestimates mortality risk in low EDSS states and underestimates it in high EDSS states
3.22
The committee considered an alternative approach based on a more recent study (Jick et al., 2014), which reported lower rates of mortality for multiple sclerosis compared with Pokorski et al. (1997) and which had been applied in a recent appraisal of cladribine tablets for treating relapsing–remitting multiple sclerosis. The committee understood that although these data were more recent, the publication did not provide separate mortality ratios for different EDSS states. Therefore, models based on Jick et al. apply the same mortality ratio for each EDSS state. The committee was concerned that this approach resulted in clinically implausible mortality rates in low EDSS states and underestimated mortality in high EDSS states. The committee concluded that the approach to mortality was a source of uncertainty, but accepted the approach taken by the assessment group because it was the most clinically plausible.
Treatment stopping rates
Utility values
Disutility to carers should be considered
3.24
The committee discussed the quality of life for people with relapsing–remitting multiple sclerosis, and the burden that their carers experience. The assessment group did not include disutility to carers in its base case because it had questioned whether this was consistent with the NICE reference case. The companies and the Department of Health did include disutilities to carers in their base-case analyses. The base cases in previous NICE technology appraisals for multiple sclerosis (such as dimethyl fumarate and natalizumab) also included disutility to carers. The committee concluded that it would include disutility to carers when making its decision.
Health-state costs
The UK MS Survey is the most appropriate source for EDSS health-state costs
3.25
The committee discussed the annual costs associated with each EDSS health state in the model. It noted that the RSS model used Kobelt et al. (2000) in its base case and that this differed from other NICE technology appraisals, which used other sources such as:
-
the UK MS Survey used in NICE's technology appraisal guidance on dimethyl fumarate, fingolimod and natalizumab
-
Tyas et al. (2007) used in NICE's technology appraisal guidance on alemtuzumab and teriflunomide.
The committee noted the following about the various sources:
-
Kobelt et al. estimated substantially higher costs in EDSS health states 7 to 9 than the other sources. Kobelt et al. included indirect costs of sickness absence, early retirement and changes in working hours, which would not be borne by the NHS or personal social services (PSS). Notably, the study did not use recent unit costs, but costs adjusted for inflation from 1999/2000 prices to 15 years later. For these reasons, the committee did not further consider costs from Kobelt et al.
-
The UK MS Survey represented the largest data set (responses from 2,048 people), and included separate estimates of costs funded by the UK government and costs funded by the NHS and PSS. The UK government-funded costs included costs other than what the NHS and PSS would cover, and it was unclear what these included. The committee was satisfied that the NHS and PSS costs estimated from the UK MS Survey were the best available and could be used in this appraisal.
-
Tyas et al. reflected another analysis of data from the UK MS Survey. However, it reported costs funded by the UK government only, and did not separately consider costs funded by the NHS and PSS. Because of this, the committee did not consider costs from Tyas et al. further.
The committee concluded that it would consider analyses using the UK MS Survey costs for EDSS health states.
Treatment costs
Treatment costs should not be applied to EDSS states 7 to 9
3.26
Teva stated that treatment costs should not be applied to EDSS states 7 to 9 because it is unlikely that these people would have treatment with glatiramer acetate or the beta interferons in clinical practice. The assessment group explained that, while many people do not stop treatment at advanced EDSS states, removing treatment costs at EDSS states 7 to 9 reflected a pathway using the drugs within their licensed indications. The committee concluded that it would base its conclusions on analyses without treatment costs applied to EDSS states 7 to 9.
Equality considerations
Stakeholders consider glatiramer acetate to be the safest drug for anyone who is planning to become pregnant
3.28
Healthcare Improvement Scotland and several stakeholders during consultation stated that glatiramer acetate is the safest drug for anyone who wants to become pregnant. Although glatiramer acetate is not contraindicated during pregnancy, its marketing authorisation suggests that it is preferable to avoid its use during pregnancy. The committee understood from consultation comments that glatiramer acetate is considered the safest drug available during the pre-conception period.
Special considerations should be given to people who cannot prepare beta interferon‑1b treatments
3.29
The committee noted comments from consultation before the fourth committee meeting that interferon beta‑1b is supplied as a solvent and powder, which patients (or carers) must mix each time they administer the treatment. This process is more difficult than treatments employing ready-to-use injection devices. The committee understood that some people will therefore have difficulty using Extavia and Betaferon, particularly people with manual dexterity, visual or cognitive difficulties, which are common in people with multiple sclerosis. The committee concluded that consideration should be given to this group of people with respect to the ease of preparation and administration of beta interferons.
Innovation
The technologies were innovative compared with best supportive care when they became available on the NHS
3.30
The committee considered that beta interferons and glatiramer acetate may have been considered innovative compared with best supportive care when they became available in the NHS. Several newer technologies have since become available that were considered innovative when compared with beta interferons and glatiramer acetate. The committee noted that the benefits of ease of preparation and administration using auto-injection devices (see section 3.29) were not captured in the cost-effectiveness analysis and took this into account.
Cost-effectiveness results
Interferon beta‑1a, interferon beta‑1b (Extavia) and glatiramer acetate are a cost-effective use of NHS resources
3.31
The committee considered the cost-effectiveness results for beta interferons and glatiramer acetate, taking into account its preferences, including waning in treatment effect (see section 3.19), using the pooled RSS results (see section 3.14 and section 3.15) and the patient access schemes where applicable. Specific incremental cost-effectiveness ratio (ICER) values cannot be reported as this would allow the back-calculation of confidential discounts.
-
The ICER for interferon beta‑1b (Extavia) compared with best supportive care was below £30,000 per QALY gained. The committee concluded that Extavia was a cost-effective use of NHS resources for people with relapsing–remitting multiple sclerosis or secondary progressive multiple sclerosis with continued relapses.
-
The committee noted that the ICERs for interferon beta‑1a compared with best supportive care were above £30,000 per QALY gained. It took into account the equality considerations applied with respect to the group of people who will find the preparation and administration of Extavia challenging (see section 3.29) because it was the only beta interferon that was cost effective at a threshold of less than £30,000 per QALY gained. The committee agreed that alternative beta interferons should be available for patients. The committee concluded that interferon beta‑1a was a cost-effective use of NHS resources for people with relapsing–remitting multiple sclerosis in this context.
-
The ICER for glatiramer acetate compared with best supportive care was below £30,000 per QALY gained. The committee was aware that a generic version of glatiramer acetate (Brabio) is available in the NHS, and understood that the price of glatiramer acetate is likely to fall in the future. The committee concluded that glatiramer acetate was a cost-effective use of NHS resources for people with relapsing–remitting multiple sclerosis.
-
The committee considered glatiramer acetate, interferon beta‑1a and interferon beta‑1b to be broadly similar in clinical effectiveness (see section 3.10). However, it noted that (interferon beta‑1b) Betaferon was the most expensive technology. In addition, the ICER for Betaferon was above £30,000 per QALY gained. The committee concluded that Betaferon was not a cost-effective use of NHS resources for people with relapsing–remitting multiple sclerosis.