Return to Vaccination News Home Page
Subscribe to the Vaccination NewsLetter
View past & current Scandals (columns by Sandy Mintz)
Search This Site using keywords
http://bmj.com/cgi/content/full/bmj;326/7403/1363
| Home | Help | Search/Archive | Feedback | Table of Contents |
BMJ 2003;326:1363 (21 June)
|
|
|||||||||||||
Diana Rose, senior researcher1, Pete Fleischmann, researcher1, Til Wykes, professor2, Morven Leese, statistician3, Jonathan Bindman, senior lecturer3
1 Service User Research Enterprise, PO34, Institute of Psychiatry, De Crespigny Park, London SE5 8AF, 2 Department of Psychology, Institute of Psychiatry, 3 Health Services Research Department, Institute of Psychiatry
Correspondence to: D Rose d.rose@iop.kcl.ac.uk
|
|
Abstract |
|---|
Objective To ascertain patients' views on the benefits of and possible
memory loss from electroconvulsive therapy.
Design Descriptive systematic review.
Data sources Psychinfo, Medline, Web of Science, and Social Science Citation Index databases, and bibliographies.
Study selection Articles with patients' views after treatment with electroconvulsive therapy.
Data extraction 26 studies carried out by clinicians and nine reports of work undertaken by patients or with the collaboration of patients were identified; 16 studies investigated the perceived benefit of electroconvulsive therapy and seven met criteria for investigating memory loss.
Data synthesis The studies showed heterogeneity. The methods used were associated with levels of perceived benefit. At least one third of patients reported persistent memory loss.
Conclusions The current statement for patients from the Royal College of Psychiatrists that over 80% of patients are satisfied with electroconvulsive therapy and that memory loss is not clinically important is unfounded.
|
|
Introduction |
|---|
Electroconvulsive therapy is generally indicated for depression that
is resistant to treatment. The procedure, which involves the
application of electrodes to the head to induce a convulsion, is
carried out under general anaesthetic. Although electroconvulsive
therapy is less commonly used today than in the past, over 11 000
patients receive it in England annually.1 Nearly
one fifth of patients receive treatment under a special section
of the Mental Health Act 1983.
The Royal College of Psychiatrists' fact sheet states that more than eight out of 10 depressed patients who receive electroconvulsive therapy respond well.2 "Electroconvulsive therapy is the most effective treatment for severe depression and people... report that it makes them feel `like themselves again' or that `life is worth living.'"2 Although reviews on attitudes to electroconvulsive therapy in the 1980s concluded that patients found treatment beneficial and that they were satisfied with it, this is currently opposed by individual patients and groups.3 4 We aimed to examine the sources of this controversy and to assess the debated distinctions between efficacy, effectiveness, and satisfaction.5 Efficacy is restricted to what can be measured in a controlled clinical trial, often over a short period. It will not necessarily predict the effectiveness of a treatment in a real life situation, still less will it predict satisfaction. For instance, a systematic review of randomised controlled trials investigated evidence of the efficacy of electroconvulsive therapy as measured by symptom scales completed by a mental health professional.6 But these ratings may not be the same as perceptions of relief of symptoms by patients themselves. For example, in one study similar numbers of patients were regarded as improved by themselves and by health professionals, but in 20% (n=13) of cases these were different individuals.7
Patients' perceptions of benefit are likely to be based on broader considerations than just the relief of symptoms. They may take into account the amount and length of time symptoms are relieved (clinical benefit) as well as any side effects. One side effect is memory loss. The Royal College of Psychiatrists' fact sheet states that while memory of recent events may be affected by electroconvulsive therapy, "in most cases this memory loss goes away within a few days or weeks although some patients continue to experience memory problems for several months. As far as we know, electroconvulsive therapy does not have any long term effects on your memory or intelligence."2 Some patients, however, report severe and longlasting memory losses after electroconvulsive therapy, and these will influence decisions on the risks and benefits of treatment.
Despite these disagreements there has been little systematic study of patients' views about the effectiveness and safety of electroconvulsive therapy. We aimed to ascertain patients' attitudes on the perceived benefit of treatment, as distinct from clinically rated outcome, and reported memory loss after treatment.
|
|
Methods |
|---|
We searched the databases Psychinfo, Medline, Web of Science, and the
Social Science Citation Index for papers and reports of patients'
views on treatment with electroconvulsive therapy (see
bmj.com for search terms). Bibliographies were also
hand searched. Articles were excluded that concerned lay or
professional opinion, children or adolescents, or where not all the
patients had received treatment.
Of the 27 papers identified, 26 were authored by academics or researchers and conducted in psychiatric facilities. A reference group enabled us to identify nine reports written either by patients or in collaboration with them. The work of Communicate, the user group at the Maudsley hospital, is awaiting publication, but we had access to its raw data. Although our searches included global sources, articles written by patients were confined to the United Kingdom in all but one case.
Analysis
We calculated the proportion of patients with positive responses to
questions on effectiveness of treatment and the 95% confidence
intervals. Positive responses were defined as an affirmative response
to the statements "electroconvulsive therapy is helpful" or "I would
have electroconvulsive therapy again." A Forrest plot was produced on
the raw (proportion) scale as to whether electroconvulsive therapy
was considered helpful, with normal approximation standard errors.
The research studies were rated on four methodological variables. These were selected from either previous research (setting and interviewer), preliminary analysis of the data (interval between treatment and interview), or the social science literature.8
Interval between treatment and interview
We considered the interval between treatment and interview because
the benefits of treatment may be short lived and side effects only
apparent later. The scores were: 0 for during course of treatment or
maintenance treatment; 1 for within four weeks or predischarge; 2 for
1-6 months; and 3 for more than six months.
Number of questions
As a few brief questions are likely to produce less engagement than a
more exploratory list of questions, we scored: 1 for five or less
questions; 2 for 6-14 questions; and 3 for 15 or more questions.
Complexity of interview
With simple response options there was less scope for patients to
express their opinions whereas multiple choice questions or
semistructured interviews allowed more complex opinions to be
recorded. The scoring system was: 1 for dichotomous responses; 2 for
simple Likert scales; 3 for complex Likert scales or multiple choice;
and 4 for a semistructured interview.
Setting of interview and status of interviewer
Conducting an interview has been shown to influence the willingness
of patients to be critical about services.9 They
are more likely to be critical when interviewed by a fellow patient
in a neutral setting. Because the setting and status are always
highly correlated, we amalgamated them into one category. The
scoring system was: 1 for inpatients; 2 for same hospital or treating
doctor; 3 for non-treating doctor or at home; 4 for day care or
voluntary sector; and 5 for source independent of health services,
and choice of setting.
Logit models were fitted to assess associations between positive responses and methodological characteristics and the distinction between clinical and patient studies. SPSS version 10 and Stata version 7 were used for the analyses.
|
|
Results |
|---|
In 16 studies patients were asked if they found electroconvulsive
therapy helpful and in 12 studies they were asked if they would have
the treatment again (table 1). The level of positive
responses varied widely between studies (tests for heterogeneity:
2=370,
P < 0.001, for treatment helpful,
2=256, P < 0.001 for would have
treatment again). The Forrest plot for "helpful" shows that the
patient led and collaborative studies report the lowest levels of
positive responses; there was, however, an overlap in the confidence
intervals (figure and table 1).
|
|
A funnel plot showed no evidence of publication bias among the clinical studies. No systematic relation was found between perceived benefit and the country, or region of the United Kingdom, where the research was undertaken.
Methodological variables
The number of questions, complexity of the interviews, and the
interval before interview were intercorrelated (between number of
questions and both the other two variables r=0.54, between interval
and complexity r=0.75). The clinical studies tended to use fewer
questions, less complex schedules, and a shorter interval, although
the difference in complexity was not significant (see table 1).
Studies where the interviews were conducted soon after treatment, in hospital settings, by the treating doctor, were more likely to report positive views of electroconvulsive therapy (table 2). Studies with low complexity schedules, few questions, and a short interval were also associated with high perceived benefit. In the case of treatment considered helpful there was a clear hierarchy in setting, as coded from studies of inpatients (coded 1) to studies based in the community (coded 5).
|
When the analyses were repeated for the clinical studies alone, the effects were in the same direction and of a similar magnitude. Because of reduced sample sizes, fewer associations were significant. Within clinical studies, the number of questions remained significantly associated with treatment considered helpful, and complexity and interval were associated with whether the patient would have treatment again. In multivariate models, only setting remained significant.
Persistent memory loss
Of the 35 studies, 20 considered memory loss as a consequence of
electroconvulsive therapy. Thirteen were excluded because data were
not given or the interval between treatment and questions about
memory loss was less than six months. In four of the remaining
studies, respondents were asked specifically whether they had
experienced persistent or permanent memory loss, and in four studies
any reported memory problem was sought (one study reported on both;
table 3).
|
The rate of reported persistent memory loss varied between 29% and 55%, but, unlike levels of perceived benefit, the rate did not seem to depend on whether studies were clinical or patient based, with relatively high levels being reported by both types of study.
|
|
Discussion |
|---|
The methods used to elicit patients' views on electroconvulsive
therapy influence the reporting of perceived benefit and willingness
to repeat treatment. Variation in levels of perceived benefit was
also related to the source of the research. Patient led studies
reported lower rates of perceived benefit than clinical studies. This
might be attributed to a selection bias, with patient studies only
selecting people who were antagonistic to treatment. The study by
Communicate, the user group at the Maudsley Hospital, is, however, a
prospective one, where the interview schedule was clearly stated to
come from a patient group. This study still reports lower rates of
satisfaction than any of the clinical studies, indicating that even
with a prospective design, patient led or collaborative research
finds lower rates of satisfaction with treatment. Our findings
suggest the difference may be attributed to a tendency for clinical
studies to take place soon after treatment, to use medical assessors
in clinical settings, and to use brief questionnaires with low
complexity for responses.
Qualitative data collected as part of a wider review supports the above conclusions but show, in addition, how patients' views on electroconvulsive therapy are often complex. These data illuminate the way in which patients make decisions about electroconvulsive therapy by weighing the risks and benefits of treatment. Most of the studies we reviewed used simple response categories that did not allow this complex trade-off and other attitudes to be described. One hypothesis is that many patients are not simply for or against the treatment or even are neutral about it. The concept of satisfaction and its measurement are also subject to these criticisms of oversimplification. Future research should include qualitative measures with representative samples of patients who have received electroconvulsive therapy.
Electroconvulsive therapy is a complex intervention comprising many stages and the involvement of many staff. Patients may have varying views about these different stages. As the literature we reviewed relied on global ratings, however, it was not possible to investigate each stage independently. The exception was the information and consent stage, which will be reported later.
Memory loss
Although the studies did not use consistent definitions or standardised ratings
for memory loss, levels were between 29% and 79%. The levels were not
determined by whether studies were clinician led or patient led, but
the two types of study did differ in their analyses and
interpretation of findings. Patient led research typically presents
numerical results and illustrates these with quotations to show what the data
mean in terms of patients' lives, whereas clinical researchers tend
to undertake further statistical analysis of the data, sometimes
ignoring the original data. For example, one study asked participants
to assess the statement that "electroconvulsive therapy permanently
wipes out large parts of memory."11 The
study then reported that people who had never received treatment were
more likely to endorse this statement than those who had received it.
It did not, however, comment on the finding that one third of
those who had received treatment agreed with the strongly worded
statement.
Another study controlled for depression in the analyses and found that memory loss continued to be significant.27 Nonetheless, the authors concluded that long term memory loss was an important problem for only a small group of people and were doubtful about the causative role of electroconvulsive therapy.
The findings relate to the experience of persistent memory loss. Routine neuropsychological tests have been used in studies of electroconvulsive therapy to establish objective measures of memory loss and concluded that there was no evidence of persistent memory loss. It would seem that these are the studies on which the Royal College of Psychiatrists based its findings. The studies, however, typically measure the ability to form new memories after treatment (antero-grade memory). Reports by patients of memory loss are of the erasing of autobiographical memories or retrograde amnesia. Thus the risks reported by patients do not appear in clinical assessments.
|
Controversy between medical opinion and patient organisations
We found possible sources of controversy between professional bodies
and some patients and patient organisations. The levels of perceived
benefit differed between patient led and clinician led studies
because different methods were used and because in many cases these
methods did not allow an adequate description of the complexity of
subjective experience. Even where findings, such as persistent memory
loss, did not differ between patient led and clinician led studies,
the interpretations may have differed radically. It is therefore not
surprising that disputes can arise between professionals and patients
and that organisations should emerge that provide support and a forum
for those who feel their treatment has not been beneficial.
Conclusion
Although clinical trials concluded that electroconvulsive therapy is
an effective treatment,6 measures of efficacy did
not take into account all the factors that may lead patients to
perceive it as beneficial or otherwise. Studies of treatment
are needed that are able to investigate a range of outcomes valued by
patients. Important among these are factors that impact on
effectiveness and satisfaction. Also important is loss of
autobiographical memory, which is widely described but insufficiently
systematically investigated.
Search terms
appear on bmj.com
Editorial by Geddes and Carney
Contributors: All authors contributed to the design of the study and the interpretation of the findings and were involved in writing the paper. The data were collected by DR and PF andanalysed by DR, TW, and ML. DR and PF have been recipients of electroconvulsive therapy. DR will act as guarantor for the paper.
Competing interests: This paper is based on a report funded by a grant from the Department of Health, England. The Department of Health has given permission for publication but does not necessarily endorse the views contained in the paper.
|
|
References |
|---|
(Accepted May 15, 2003)
This article has been cited by other articles:
![]() |
S. Carney and J. Geddes Electroconvulsive therapy BMJ, June 19, 2003; 326(7403): 1343 - 1344. [Full Text] [PDF] |
||||
Read all Rapid responses
|
|
||||||||||||
| Home | Help | Search/Archive | Feedback | Table of Contents |
© 2003 BMJ Publishing Group Ltd
Return to Vaccination News Home Page
DISCLAIMER: All information, data, and material contained, presented, or provided here is for general information purposes only and is not to be construed as reflecting the knowledge or opinions of the publisher, and is not to be construed or intended as providing medical or legal advice. The decision whether or not to vaccinate is an important and complex issue and should be made by you, and you alone, in consultation with your health care provider.