Criticisms of Evidence-based Medicine
The problem-solving model clearly has limitations particularly in areas where the types of evidence privileged in an EBM approach do not map well onto the existing evidence base. Elliott and Popay ( 2000 ) summarize key criticisms of EBM as they apply to its use within policymaking processes: it is “too closely identified with randomized control trials, marginalizing research using other designs” (462). Even more importantly, EBM does not address how to weigh or integrate the types of value judgments which are required when writing policy, nor are there standardized methodologies for how to integrate evidence based on research, clinical practice, and patient experiences. Finally, EBM alone does not provide guidance on how make evidence transferable to practice, or in this case to CPGs.
EBM is a management decision tool, not scientific, though it can use some scientific methods.
This basic criticism is what I raised about the IOM review. For EBM to have some reliability there has to be a large, well funded and otherwise adequate research effort. In situations where there is any distortion or bias or lack of interest, such methodologies increase the risk of bias in my view, they do not decrease it. EBM is a tool to indicate, not prove, that some treatment options are better than others. When you look at EBM for other than clinical trials its very hard to even find guidelines.
One thing I really dislike is confusion over first rank evidence and gold standard clinical trials. RCTs are NOT gold class studies. They are NOT first rank evidence. They can be high ranking evidence if they fulfill a whole bunch of caveats. Like having placebo controls, and a high effect size, and being double blinded.
Its all about reducing bias, and in many cases EBM increases bias, due to methodological failings.
Many do not know that for clinical trials, in many cases case controlled series are the highest form of evidence as well. Its about things like sample size and methodology and effect size.
Many seem unaware that sometimes an RCT is absurd, so rejecting evidence because its not from an RCT is equally absurd. Basic research falls into this category. Research on the mechanism of a specific biochemical marker, for example, is not applicable to RCT methodology.
Since ME and CFS have underfunded and rather narrow research efforts for the most part, with some severe distortions (including funding distortions) the reliability of any EBM investigation into ME or CFS is in question. In another five, ten or twenty years this might change. What wont change is the reliability of current methods, and the inherent methodological distortions. Its not enough to rubber stamp studies as good or poor quality before doing in-depth investigation. Its not enough to accept the methodology used, or to rubber stamp it, or to ignore issues because there is not enough funding, time or resources to look into poor methodology. Similar issues occur with ignoring good methodology in studies that do not otherwise meet cookie cutter standards of excellence.