By David Tuller, DrPH
I just wrote about how PACE was favorably cited in
an article in Nature Reviews Cardiology. Last month, that piece of crap was also included as part of yet another meta-analysis that mushed together the findings from a load of bad papers and concluded that, collectively, they prove something or other. This
new paper—
“Efficacy and Acceptance of Cognitive Behavioral Therapy in Adults with Chronic Fatigue Syndrome: A Meta‐analysis”–was published by the International Journal of Behavioral Medicine and written by investigators from the clinical psychology department at the University of Wuppertal in Wuppertal, Germany.
Was the situation really calling out for yet another major review of trials of psycho-behavioral treatments for what the investigators insist on calling CFS? According to this crew, yes.
The strategy here appears to consist of throwing review after review at the issue, with each new iteration making claims that CBT and/or GET are effective, and arguing soberly that these new findings add further weight to the body of evidence—without pointing out that every review includes some grouping of the same universe of stupid and inadequate studies. When you’re a kid, you learn pretty quickly that if you add a pile of mud to another pile of mud, you just get a bigger mud pile. I guess some people skip that lesson.
In this case, the investigators accept without question the validity of findings from unblinded studies relying on subjective outcomes—the standard design for research in this domain. Unfortunately, this study design is a recipe for generating unknown amounts of bias. Of course, combining biased studies with other biased studies does nothing to eliminate the bias. For unexplained reasons, the meta-analysis ignored null or clinically insignificant results from objective measures included in the body of research—such as, in the PACE trial, the six-minute walking test, step-test for fitness, employment status, and social welfare status. Overlooking or ignoring outright objective outcomes that contradict subjective ones is unacceptable in scientific reporting.....................