Vaccination News Home Page subscribe Vaccination NewsLetter
http://bmj.com/cgi/content/full/326/7394/832
BMJ 2003;326:832-833 ( 19 April )
Determinants of outcome include technical skill, volume of work, and case mix
Surgery can be a risky business. Members of the public are now attuned to that fact and appreciate that their surgeon's performance is a key determinant of success. Outcome after surgery is of course relatively easy to assess; you survive the operation or you don't, the anastomosis holds or it doesn't, the hernia recurs or it doesn't, and so on. In an era of increased scrutiny it is perhaps no surprise that surgeons feel under pressure or that they account for a third of the referrals to the newly established National Clinical Assessment Authority in England.1
What then are the determinants of surgical performance, and is a poorly
performing surgeon easy to spot? Technical skill is vital, but it is
by no means the only essential ingredient for success. Thorough
training, compassion, sound judgment, good communication skills,
honed clinical skills, and knowledge are all critically important.
Surgeons do not work in isolation and success depends on effective
collaboration and team working. This is not to submerge the surgeon
in anonymity
surgical teams need enlightened leadership if they are to
serve their patients well.
Increasing emphasis has been put on the relation between volume of surgical
activity and outcome. One always imagined that the two were related
after
all, even the greatest golfers have to play and practise regularly.
There is now abundant evidence that hospitals with higher volumes of
activity tend to have better outcomes and emerging evidence that
surgeon's volume of work is also a determinant of outcome.2-6 Areas where the relation between
hospital volume and outcome is now clear include major surgery for
certain cancers, cardiac surgery, liver transplantation, and major
vascular surgery. However, words of caution are needed. The relation
is not linear; some low volume units achieve good results whereas
higher levels of activity do not necessarily guarantee good outcomes.7
Complexity of case mix must be allowed for; databases must be sufficiently large to allow robust comparisons; and trainees must be able to learn their craft. Comparison between hospitals is difficult, but it can be even more difficult to identify a poorly performing individual. Hospital outcomes can hide large differences between surgeons, and referral to a high volume hospital does not guarantee that surgery will be performed by a high volume surgeon. Even "busy" surgeons may take a long time to accrete enough performance data to allow valid comparison with their peers, particularly in low volume specialties such as neurosurgery.
The European carotid surgery trial provides a lesson in some of the pitfalls when assessing surgical performance.8 In this trial the overall risk of major stroke and death within 30 days was 7%. Seventy one of the 147 participating surgeons did not encounter strokes or deaths during the operation. However, for a 0% risk of stroke or death to be significantly lower than the overall risk of 7% a surgeon would have had to operate on at least 50 patients, whereas most of the 71 had operated on less than five. At the other end of the spectrum, surgeons with the highest risks (50% and 33%) had operated on only two and three patients, respectively. Only surgeon X seemed to have a significantly increased operative risk (11 strokes or deaths in 50 patients), but after correction for case mix even he ceased to be a statistically significant "outlier." This is not to say that alarm bells should not ring when a surgeon seems to be performing suboptimally, merely that care must be taken when interpreting what seem to be unusually high or low risks.
Our understanding of medical error and misadventure owes a great deal to the work of James Reason and the recognition that shortcomings of the system rather than the individual are often responsible.9 The system approach recognises that individuals are fallible, sees errors and mishaps as consequences not causes, and deals with failings in the organisation of the system concerned. There are encouraging signs that the United Kingdom is moving away from a knee jerk "name, blame, and shame" approach to medical misadventure and undue reliance on raw league tables.
While there may be occasional surgical "rotten apples," most errors in
surgery (as in other disciplines) are committed by well trained, well
motivated individuals. This is not to absolve individual surgeons
from responsibility for their performance or lessen the importance of
audit and peer review. In their haste to acquire new technology,
surgeons have not always acquitted themselves well,10
although there are now encouraging signs that specialised techniques
for
example, total mesorectal excision for rectal cancer
can be acquired
widely with appropriate training programmes. 11
12 We need to be sure that members of the public
do not have unrealistic expectations of their surgeon and their
surgery and that they understand the risks beforehand. Equally we
need to ensure that patients at higher risk are not denied surgery
because no one is willing to operate on them. We need to work
collectively to develop a truly open system that limits the incidence
of error, recognises risk, allows surgeons (and all healthcare
professionals) to learn from mistakes, and replaces blame and
retribution with an opportunity for learning and training.
PPP Foundation, London W1G 0PQ
Footnotes
Competing interests: None declared.
| 1. | White C. Surgeons top number of referrals to
assessment authority. BMJ 2002; 325: 235 |
| 2. | Halm EA, Lee C, Chassin MR. How is volume related to quality in health care? A systematic review of the research literature. Washington, DC: Institute of Medicine, 2000. |
| 3. | Birkmeyer JD, Siewers AE, Finlayson EV, Stukel TA,
Lucas FL, Batista I, et al. Hospital volume and surgical mortality
in the United States. N Engl J Med 2002; 346: 1128-1137 |
| 4. | Begg CB, Riedel ER, Bach PB, Kattan MW, Schrag D,
Warren JL, et al. Variations in morbidity after radical
prostatectomy. N Engl J Med 2002; 346: 1138-1144 |
| 5. | Martling A, Cedermark B, Johansson H, Rutqvist LE, Holm T. The surgeon as a prognostic factor after the introduction of total mesorectal excision in the treatment of rectal cancer. Br J Surg 2002; 89: 1008-1013[CrossRef][ISI][Medline]. |
| 6. | Cowan JA, Dimick JB, Thompson BG., Stanley JC. Surgeon volume as an indicator of outcomes after carotid endarterectomy: an effect independent of specialty practice and hospital volume. J Am Coll Surg 2002; 195: 814-821[CrossRef][ISI][Medline]. |
| 7. | Lieberman MD, Kilburn H, Lindsey M, Brennan M. Relation of perioperative deaths to hospital volume among patients undergoing pancreatic resection for malignancy. Ann Surg 1995; 222: 638-645[ISI][Medline]. |
| 8. | Rothwell PM, Warlow CP, on behalf of European Carotid Surgery Trialists' Collaborative Group. Interpretation of operative risks of individual surgeons. Lancet 1999; 353: 1325[CrossRef][ISI][Medline]. |
| 9. | Reason J. Human error: modes and management. BMJ
2000; 320: 768-770 |
| 10. | Cameron JL, Gadacz T. Laparoscopic cholecystectomy. Ann Surg 1991; 213: 1-2[ISI][Medline] |
| 11. | Kapieijn E, Putter H, van de Velde CJH, cooperative investigators of the Dutch ColoRectal Cancer Group. Impact of the introduction and training of total mesorectal excision on recurrence and survival in rectal cancer in the Netherlands. Br J Surg 2002; 89: 1142-1149[CrossRef][ISI][Medline]. |
| 12. | Martling AL, Holm T, Rutqvist LE, Moran BJ, Heald RJ, Cedermark B. Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Stockholm Colorectal Cancer Study Group. Basingstoke Bowel Cancer Research Project. Lancet 2000; 356: 93-96[CrossRef][ISI][Medline]. |
ALL INFORMATION, DATA, AND
MATERIAL CONTAINED, PRESENTED, OR PROVIDED HERE IS FOR GENERAL INFORMATION
PURPOSES ONLY AND IS NOT TO BE CONSTRUED AS REFLECTING THE KNOWLEDGE OR OPINIONS
OF THE PUBLISHER, AND IS NOT TO BE CONSTRUED OR INTENDED AS PROVIDING MEDICAL OR
LEGAL ADVICE. THE DECISION WHETHER OR NOT TO VACCINATE IS AN IMPORTANT AND
COMPLEX ISSUE AND SHOULD BE MADE BY YOU, AND YOU ALONE, IN CONSULTATION WITH
YOUR HEALTH CARE PROVIDER.