Kati
Patient in training
- Messages
- 5,497
Trevor Butterworth is the director at Sense about Science USA
2
- There was no committee approval for the re-definition of “recovery”.
- “Recovery” rates for CBT and GET were not statistically significant.
- The PACE PIs originally reported “recovery” rates of 22% for CBT and GET.
- The published “recovery” rates were based on thresholds that deviated substantially from the published protocol and were inflated by an average of four-fold.
- In contrast to the published paper by the PIs, the recovery rates in the CBT and GET groups are not significantly higher than in the SMC (standard medical care) group alone.
- APT (adaptive pacing therapy) was a highly modified version of “pacing” (preferred by patients).
- 13% of participants at baseline simultaneously met the trial entry criteria for
“significant disability” and the revised “recovery” criteria.
APT 8% (but according to the protocol are 2%) CBT 22% (but according to the protocol are 7%) GET 22% (but according to the protocol are 4%)
- The Investigators excluded drop-outs, which is not recommended practice in clinical trials.
- Logistic regression (used by the PIs) has been shown to be an inappropriate method of analysis in randomised trials.
- The figures originally given by the PIs for the four groups were:
SMC 7% (but according to the protocol are 3%)
11. “Our findings therefore contradict the conclusion of White et al (2013) that CBT and GET were significantly more likely than the SMC group to be associated with ‘recovery’ at 52 weeks”.
12. “The multiple changes to the recovery criteria had inflated the estimates of recovery by approximately 2.3 to 5.1-fold, depending on the group, with an average inflation of 3.8-fold”.
13. When using the revised recovery criteria, 8% of the “recovered” participants still met trial eligibility criteria for “significant disability”.
14. “The changes made by the PACE investigators after the trial was well under way resulted in the recovery criteria becoming too lax to allow conclusions about the efficacy of CBT and GET as rehabilitative treatments for CFS”.
15. “This analysis, based on the published trial protocol, demonstrates that the major changes to the thresholds for recovery had inflated the estimates of recovery by an average of approximately four-fold”.
16. “It is clear from these results that the changes made to the protocol were not minor or insignificant, as they have produced major differences that warrant further consideration”.
17. “The PACE trial provides a good example of the problems that can occur when investigators are allowed to substantially deviate from the trial protocol without adequate justification or scrutiny”.
18. “It seems prudent that the published trial results should be treated as potentially unsound, as well as the medical texts, review articles, and public policies based on those results”.
we can now all safely donate various body fluids, tissues etc?
What a magnificently condescending - and unintentionally hilarious given the recurring Naked Gun joke, which he can't have been aware of - dismissive comment for him to make.
move along folks nothing to see here
My understanding is that this comment was someone paraphrasing over his general attitude to PACE not a direct quote.
Measurement error, time lag, unmeasured confounding: Considerations for longitudinal estimation of the effect of a mediator in randomised clinical trials.
Goldsmith KA1, Chalder T2, White PD3, Sharpe M4, Pickles A5.
Author information
Abstract
Clinical trials are expensive and time-consuming and so should also be used to study how treatments work, allowing for the evaluation of theoretical treatment models and refinement and improvement of treatments. These treatment processes can be studied using mediation analysis. Randomised treatment makes some of the assumptions of mediation models plausible, but the mediator-outcome relationship could remain subject to bias. In addition, mediation is assumed to be a temporally ordered longitudinal process, but estimation in most mediation studies to date has been cross-sectional and unable to explore this assumption. This study used longitudinal structural equation modelling of mediator and outcome measurements from the PACE trial of rehabilitative treatments for chronic fatigue syndrome (ISRCTN 54285094) to address these issues. In particular, autoregressive and simplex models were used to study measurement error in the mediator, different time lags in the mediator-outcome relationship, unmeasured confounding of the mediator and outcome, and the assumption of a constant mediator-outcome relationship over time. Results showed that allowing for measurement error and unmeasured confounding were important. Contemporaneous rather than lagged mediator-outcome effects were more consistent with the data, possibly due to the wide spacing of measurements. Assuming a constant mediator-outcome relationship over time increased precision.
© The Author(s) 2016.
KEYWORDS:
Mediation; chronic fatigue syndrome; clinical trials; longitudinal mediation models; measurement error; structural equation models
PMID:
I'm confused, is someone claiming that Wessely actually said...
and if he did is there a link to it?
My understanding is that this comment was someone paraphrasing over his general attitude to PACE not a direct quote.
That's how I read it as well. Though I can understand how brainfog can contribute towards a misinterpretation.
He didn't say those exact words... but his response was lacking everything we could have hoped it to be. Like an apology, or gee, maybe I need to re-evaluate my stance, or anything indicating that this was new news to him even.
The 'lack of' response to me is quite telling even - that they knew. They aren't shocked by the new numbers. They aren't arguing that the new numbers are wrong. (even more fuel for the belief that there was a conscious decision to mis-represent).
hmmmm...He summarized his overall reaction to the new analysis this way: “OK folks, nothing to see here, move along please.”
hmmmm...
OK, so who is "he" here...
I was thinking this read as "SOMEONE other than Wessely" summarized "Wessely's" overall reaction
The PACE researchers, the editor of the Lancet, and the editors of Psychological Medicine (which published the follow-up study on recovery) all declined to comment for this article.
Simon Wessely, president of the UK Royal College of Psychiatrists, defended the trial in an email exchange with me. He argued that some patients did improve with the help of cognitive behavior therapy or exercise, and noted that the improvement data, unlike the recovery data, was statistically significant. “The message remains unchanged,” he wrote, calling both treatments “modestly effective.”
Wessely declined to comment on the lack of recovery. He summarized his overall reaction to the new analysis this way: “OK folks, nothing to see here, move along please.” https://www.statnews.com/2016/09/21/chronic-fatigue-syndrome-pace-trial/
the improvement data, unlike the recovery data, was statistically significant.
“The message remains unchanged"
the message is the same except that the message is that the recovery data has changed and it shows zero recovery proof which is different to the original message and that the improvement reanalysis carries the same message as the published fanfare..... and that is that the message is that it is modestly effective and not moderately effective which means that the message has significantly changed except that the message remains the same.
Isn't it the author of the piece paraphrasing over Wesselys general attitude to the reanalysis?