Are selective COX 2 inhibitors superior to traditional non steroidal
anti-inflammatory drugs?
Adequate analysis of the CLASS trial indicates that this
may not be the case
Selective cyclo-oxygenase 2 (COX 2) inhibitors, including celecoxib (Celebrex)
and rofecoxib (Vioxx), are hypothesised tohave a lower risk of
gastrointestinal complications than traditionalnon-steroidal
anti-inflammatory drugs.1 In September 2000 thecelecoxib long term arthritis safety study, better known as CLASS,was published in JAMA.2 This trial,
widely cited and distributed,concluded that a COX 2 inhibitor was
associated with a lower incidenceof complications than traditional
non-steroidal anti-inflammatorydrugs. What was much less widely
publicised were criticisms thatcontradicted this
conclusion.
CLASS was reported as a three arm trial comparing celecoxib 800 mg/day with
ibuprofen 2400 mg/day and diclofenac 150 mg/dayin osteoarthritis or
rheumatoid arthritis. Clinically relevantupper gastrointestinal
ulcer complications (bleeding, perforation,or obstruction) and
symptomatic ulcers during the first six monthsof treatment were
described as the two main outcome measures,comparing incidence rates
for celecoxib and a traditional non-steroidalanti-inflammatory drug
(fig 1). It was concluded that, comparedwith the
traditional non-steroidal anti-inflammatory drug, celecoxib"was
associated with a lower incidence of symptomatic ulcers andulcer
complications combined."3 The trial was funded by
celecoxib'smanufacturerPharmacia.
An article in the Washington Post in August 20013
and two letters published in JAMA in November 2001 45 drew attentionto the fact that
complete information available to the UnitedStates Food and Drug
Administration contradicted these conclusions.The paper reporting
CLASS2 actually referred to the combined
analysis of the results of the first six months of two separateand
longer trials. The protocols of these trials differed markedlyfrom
the published paper in design, outcomes, duration of followup, andanalysis.
Two comparisons were originally planned: celecoxib versus ibuprofen, and
celecoxib versus diclofenac. The Food and Drug Administrationwas
concerned that selective COX 2 inhibitors could interferewith the
benefits of COX 2 in ulcer healing.6 This could
leadto a long term increase of ulcer related complications that
occurwithout warning symptoms.4
Therefore the pre-specified primaryoutcome was ulcer related
complications, not symptomatic ulcers,in both trials, while the
maximum duration of follow up was 15and 12 months respectively.7-8
A two step procedure was planned to control for a type 1 error: after
comparing celecoxib with the non-steroidal anti-inflammatorydrugs
combined, a pairwise comparison of celecoxib with each ofthe two
non-steroidal anti-inflammatory drugs, ibuprofen and diclofenac,had
to be done. The protocol explicitly specified that celecoxibwould be
claimed to be different from the traditional non-steroidal
anti-inflammatory drug only if both overall and pairwise comparisons
were statistically significant for ulcer related complications.7
Fig 1. Main results according to
published report (top) and pre-specified protocol (bottom). Alternate
definition of ulcer related complications, pre-specified by the FDA,
included more stringent criteria to address serious gastrointestinal
bleeding. P values are from log rank tests.
Analysis according to a pre-specified protocol showed similar numbers of
ulcer related complications in the comparison groups(fig
1). 78
Almost all the ulcer complications that had occurredduring the
second half of the trials were in users of celecoxib(fig
2). When an alternate definition of ulcer related
complications(pre-planned by the Food and Drug Administration) was
used, anon-significant trend was found in favour of diclofenac (fig
1). 78
These results clearly contradict the published conclusions.2They were available when the manuscript was submitted, but were
neither referred to in the article2 nor reported to
JAMA.9
Fig 2. Kaplan-Meier estimates for
ulcer complications according to traditional definition. Results are
truncated after 12 months, no ulcer complications occurred after this
period. Adapted from Lu 2001.7
Two issues cause concern. Firstly, the authors' explanations9
for these serious irregularities were inadequate. They failedto
justify the post hoc changes in design, outcomes, and analysisand
provided an unconvincing explanation for considering the sixmonth
follow up only. They argued that a large and differentialdropout
rate had occurred during the later stage of the trial,which depleted
patients with gastrointestinal adverse events preferentiallyin the
groups taking non-steroidal anti-inflammatory drugs andthat these
patients were at higher risk of developing ulcer related
complications.9 However, the absolute number of
dropouts andwithdrawals, both overall and due to gastrointestinal
adverseevents, increased gradually, without any sudden increase
aftersix months, and withdrawal rates stayed roughly constant in
differenttreatment groups during the entire follow up period. In
addition,there was no robust evidence that gastrointestinal adverse
eventswere actually a risk factor for ulcer related complications.7-8
Secondly, the flawed findings published in the original article2
appear to be widely distributed and believed. About 30000 reprints
of CLASS were bought from the publisher (W Bartolotta,personal
communication), and a recent search of the Science CitationIndex
yielded 169 articles citing it, more than 10 times as manycitations
as for any other article published in the same issue.This wide
distribution and citation has coincided with the salesof celecoxib
increasing from $2623m in 2000 to $3114m in 2001.10
Publishing and distributing overoptimistic short term data using post hoc
changes to the protocol, while omitting disappointinglong term data
of two trials, which involved large numbers ofvolunteers, is
misleading. While some of the problems relatedto CLASS were
partially covered in the news sections of BMJ11and other journals, it was not emphasised how flawed the trial
actually was,2 and how inadequate the authors'
justifications.9Consequently, CLASS may
still be relied on by many physicianswithout reference to these
flaws. In our experience most stillbelieve the findings published
originally.2 For example, mostof
58 physicians attending an osteoarthritis workshop in Berne,
Switzerland, in December 2001 had not realised that CLASS was
seriouslybiased.
In contrast with the CLASS trial,2 the VIGOR
trial,12 which was similar in design and outcomes,
found an unequivocalbenefit of another selective COX 2 inhibitor,
rofecoxib, overtraditional non-steroidal anti-inflammatory agents.
Four potentialreasons for this discrepancy warrant further
exploration. Firstly,aspirin was used concurrently by about 20% of
patients in CLASS(but not in VIGOR). Secondly, naproxen, rather than
diclofenac(which has greater COX 2 selectivity1),
was used as the comparatorin VIGOR. Thirdly, CLASS employed higher
doses of celecoxib thanusual, and finally rofecoxib has considerably
higher COX 2 selectivitythan celecoxib.1
Two things need to happen now. Firstly, an "industry independent," individual
patient data meta-analysis of all large scale,long term trials of
selective COX 2 inhibitors must be performedto include both
published and unpublished data. Secondly, thewide dissemination of
the misleading results of the CLASS trialhas to be counterbalanced
by the equally wide dissemination ofthe findings of the reanalysis
according to the original protocol.If this is not done, the
pharmaceutical industry will feel noneed to put the record straight
in this or any futureinstances.
Peter Jüni, senior research fellow.
Departments of Rheumatology, and Social and Preventive Medicine, University
of Berne, 3010 Berne, Switzerland (peter.juni@insel.ch)
Anne WS Rutjes, research fellow.
Department of Clinical Epidemiology and Biostatistics, Academic Medical
Center, University of Amsterdam, PO Box 22700, 1100 DE Amsterdam, Netherlands
Paul A Dieppe, professor of health services research.
MRC Health Services Research Collaboration, Department of Social Medicine,
University of Bristol, Bristol BS8 2PR
Acknowledgments
We thank Barker Bausell, Jiri Chard, and Matthias Egger for helpful comments,
and Wanda Bartolotta for providing data on thenumber of reprints
made available byJAMA.
Footnotes
PJ is supported by the Swiss National Science Foundation, AR by the
Netherlands Organisation for Scientific Research, andPD by the UK
Medical ResearchCouncil.
Warner TD, Giuliano F, Vojnovic I, Bukasa A, Mitchell JA,
Vane JR. Nonsteroid drug selectivities for cyclo-oxygenase-1 rather than
cyclo- oxygenase-2 are associated with human gastrointestinal toxicity: a
full in vitro analysis. Proc Natl Acad Sci USA 1999; 96: 7563-7568[Abstract/Full
Text].
Silverstein FE, Faich G, Goldstein JL, Simon LS, Pincus T,
Whelton A, et al. Gastrointestinal toxicity with celecoxib vs nonsteroidal
anti- inflammatory drugs for osteoarthritis and rheumatoid arthritis: the
CLASS study: a randomized controlled trial. Celecoxib Long-term Arthritis
Safety Study. JAMA 2000; 284: 1247-1255[Medline].
Bombardier C, Laine L, Reicin A, Shapiro D, Burgos-Vargas
R, Davis B, et al. Comparison of upper gastrointestinal toxicity of
rofecoxib and naproxen in patients with rheumatoid arthritis. VIGOR Study
Group. N Engl J Med 2000; 343: 1520-1528[Abstract/Full
Text].
ALL INFORMATION, DATA, AND
MATERIAL CONTAINED, PRESENTED, OR PROVIDED HERE IS FOR GENERAL INFORMATION
PURPOSES ONLY AND IS NOT TO BE CONSTRUED AS REFLECTING THE KNOWLEDGE OR OPINIONS
OF THE PUBLISHER, AND IS NOT TO BE CONSTRUED OR INTENDED AS PROVIDING MEDICAL OR
LEGAL ADVICE. THE DECISION WHETHER OR NOT TO VACCINATE IS AN IMPORTANT AND
COMPLEX ISSUE AND SHOULD BE MADE BY YOU, AND YOU ALONE, IN CONSULTATION WITH
YOUR HEALTH CARE PROVIDER.
"A foolish faith in authority is the worst enemy of truth."
-- Albert Einstein, letter to a friend, 1901
"I know of no safe depository of the ultimate powers of the society but the people themselves, and if we think them not enlightened enough to exercise control with a wholesome discretion, the remedy is not to take it from them, but to inform their discretion by education."
-- Thomas Jefferson, letter to William C. Jarvis, September 28, 1820
"What's the point of vaccination if it doesn't protect you from the unvaccinated?"
-- Sandy Gottstein
"Who gets to decide what the greater good is and how many will be sacrificed to it?"