• Welcome to Phoenix Rising!

    Created in 2008, Phoenix Rising is the largest and oldest forum dedicated to furthering the understanding of and finding treatments for complex chronic illnesses such as chronic fatigue syndrome (ME/CFS), fibromyalgia (FM), long COVID, postural orthostatic tachycardia syndrome (POTS), mast cell activation syndrome (MCAS), and allied diseases.

    To become a member, simply click the Register button at the top right.

BMJ Editor's Choice: Evidence based medicine: flawed system but still the best we’ve got

Firestormm

Senior Member
Messages
5,055
Location
Cornwall England
Evidence based medicine: flawed system but still the best we’ve got
Fiona Godlee, editor, BMJ

fgodlee@bmj.com

Evidence based medicine is so much part of the air we breathe it can be hard to remember a time before it. An oral history, filmed for a joint JAMA and BMJ celebration last year, has now been published on bmj.com/evidence and the JAMA network. As summarised in an editorial co-published by the two journals this week, the story features a satisfying array of heroes and detractors, forward progress and backlash (doi:10.1136/bmj.g371).

Why did evidence based medicine take off? In the video, and quoted in the editorial, David Sackett provides two main reasons: it was supported by senior clinicians who were secure in their practice and happy to be challenged, and it empowered younger doctors—and subsequently nurses and other clinicians—to question received wisdom and practice.

Sackett and his generation also succeeded because they were natural iconoclasts. And now that evidence based medicine is part of the medical establishment and is itself an icon, it’s only right that it has become a target for the new iconoclasts. In a recent column Des Spence claimed that evidence based medicine was broken and that the research pond was polluted by fraud, sham diagnosis, short term data, poor regulation, surrogate endpoints, and clinically irrelevant outcomes (doi:10.1136/bmj.g22).

Spence said that evidence based medicine left no room for discretion and fuelled overdiagnosis and overtreatment. A good number of rapid responders agreed (http://bit.ly/1jkDFZ8), some even saying he didn’t go far enough. Others defended the precepts of evidence based medicine and warned against throwing the baby out with the bathwater.

This week we highlight a story that could be used to argue either way. Rita Redberg and colleagues describe the saga of the Wingspan intracranial stenting device (doi:10.1136/bmj.g93). They tell us that its continued licensing and use in people with a previous stroke were based on a single, industry funded, uncontrolled study of 44 patients, while the only randomised trial showed clear evidence of increased deaths and strokes when the device was compared with medical treatment.

The Wingspan has been licensed under a special regulatory programme for high risk devices in rare conditions. In an accompanying commentary, Hwang and colleagues highlight the generally poor quality of the evidence for such devices, mainly small and uncontrolled studies (doi:10.1136/bmj.g217). Both sets of authors call for far greater regulatory scrutiny of the safety and effectiveness of medical devices.

As with democracy and peer review (with apologies to Winston Churchill), evidence based medicine may be the worst system for clinical decision making, except for all those other systems that have been tried from time to time. It is only as good as the evidence and the people making the decisions.

Cite this as: BMJ 2014;348:g440
 

alex3619

Senior Member
Messages
13,810
Location
Logan, Queensland, Australia
EBM is like finding a good hammer in your tool box. Its so good you hammer all the nails in, then the screws, then start on the bolts. Its not evidence based principles that are the problem, its the limits to evidence based medicine, and the purpose to which many vested interests put it. Its still too immature a discipline, and definitely not a science, to be what we want it to be. It can improve, but to do that we need to keep chipping away at the bits that do not belong.
 

A.B.

Senior Member
Messages
3,780
Industry sponsored research is simply not trustworthy when money is at stake. I'm very glad that independent research still exists.
 
Last edited:
Messages
15,786
There needs to be systems of accountability in place.

At the moment, spinning data to make it seem like your results are more impressive than they are is good for a researchers career. We need to change that.
I vote for jail time :D Or extensive community service for the benefit of the people harmed by the spin.
 

user9876

Senior Member
Messages
4,556
I vote for jail time :D Or extensive community service for the benefit of the people harmed by the spin.

If there was a prosecution of a drug company (or academic researchers/universities) for manslaughter or ABH/GBH assault depending on the level of harm they had caused that might lead to a huge change in culture. If someone knowingly covers up harms done by a drug or other medical treatment then I think they deserve such treatment.

Equally is a scientist knowingly misrepresents the positive outcomes leading people to take risks in trying a treatment that won't work I see no reason why they should not be prosecuted.

Where bad results are the result of incompetence I think we have to ask how people keep their jobs. In the current system they just seem to get more funding.

When the corporate culture was deemed bad around financial reporting leading to Enron's collapse the failure to correctly report financial results became a criminal offense in the US and this lead to a cultural change.