Response bias occurs when patients in a clinical trial - which may include CFS trials - artificially inflate their scores to please researchers. It is recognised as a potential problem, but there isn't a lot of good research on it. A recent paper from placebo expert Asbjorn Hrobjartsson discusses some of the issues with response bias, as it can artificially inflate the response to placebo treatment too.
Placebo effect studies are susceptible to response bias and to other types of biases.
Hrbjartsson A, Kaptchuk TJ, Miller FG. (2011)
Abstract (highlights)
OBJECTIVE: Investigations of the effect of placebo are often challenging to conduct and interpret. The history of placebo shows that assessment of its clinical significance has a real potential to be biased. We analyze and discuss typical types of bias in studies on placebo.
...RESULTS: The inherent nonblinded comparison between placebo and no-treatment is the best research design we have in estimating effects of placebo, both in a clinical and in an experimental setting, but the difference between placebo and no-treatment remains an approximate and fairly crude reflection of the true effect of placebo interventions. A main problem is response bias in trials with outcomes that are based on patients' reports...
CONCLUSIONS:Creative experimental efforts are needed to assess rigorously the clinical significance of placebo interventions and investigate the component elements that may contribute to the therapeutic benefit.
Background on placebo studies
Hrobjartsson famously demonstrated that placebo effects in general have been greatly overestimated. The critical mistake was to assume all improvement from baseline in the placebo group of clinical trials was due to the placebo itself, when there are other explanations including natural improvement and regression to the mean. By comparing placebo groups with more appropriate groups eg waiting list or 'no treatment' groups, he showed that placebos did not generally produce powerful clinical effects. These findings were broadly confirmed in even larger meta-analyses, most recently in 2010.
Nonetheless, the placebo effect is not dead, as he points out in this paper:
Placebo effect studies are susceptible to response bias and to other types of biases.
Hrbjartsson A, Kaptchuk TJ, Miller FG. (2011)
Abstract (highlights)
OBJECTIVE: Investigations of the effect of placebo are often challenging to conduct and interpret. The history of placebo shows that assessment of its clinical significance has a real potential to be biased. We analyze and discuss typical types of bias in studies on placebo.
...RESULTS: The inherent nonblinded comparison between placebo and no-treatment is the best research design we have in estimating effects of placebo, both in a clinical and in an experimental setting, but the difference between placebo and no-treatment remains an approximate and fairly crude reflection of the true effect of placebo interventions. A main problem is response bias in trials with outcomes that are based on patients' reports...
CONCLUSIONS:Creative experimental efforts are needed to assess rigorously the clinical significance of placebo interventions and investigate the component elements that may contribute to the therapeutic benefit.
Background on placebo studies
Hrobjartsson famously demonstrated that placebo effects in general have been greatly overestimated. The critical mistake was to assume all improvement from baseline in the placebo group of clinical trials was due to the placebo itself, when there are other explanations including natural improvement and regression to the mean. By comparing placebo groups with more appropriate groups eg waiting list or 'no treatment' groups, he showed that placebos did not generally produce powerful clinical effects. These findings were broadly confirmed in even larger meta-analyses, most recently in 2010.
Nonetheless, the placebo effect is not dead, as he points out in this paper:
The issue with patient-reported outcomes is where response bias comes in, and is particularly relevant to CFS studies where almost all outcomes are self-reported. The general problem is set up in this paper as:it is unwarranted to conclude that placebo interventions are incapable of producing clinically meaningful benefit.
...the meta-analyses [13-15] identified several well-designed clinical trials with relatively large analgesic effects of placebo, and a general tendency for effects on patient-reported continuous outcomes.
I've picked out key points from the discussion of response bias:The challenge in rigorously assessing the clinical benefit of placebo interventions is to reliably distinguish the magnitude of any real effect of placebo from the noise embedded in the human interaction of an experiment or a clinical trial.
Of course, in non-blinded and non-placebo-controlled studies, such as the PACE Trial, this doesn't apply and response bias can indeed distort results. PACE relied on therapy with an average of 13 hours of contact between therapist and patient, and a typical patients-therapist relationship that was independently assessed as 'very strong'. Such a strong patient-provider relationship is likely to be a causal factor in response bias, as this paper spells out.The conundrum of response bias
The assessment of the placebo effect faces a basic conundrum. Patients may desire to please the researcher, or just give a correct or expected answer that fits with the experimental situation [19,22]. When patients report that they feel better after receiving a placebo intervention how do we know to which degree this reflects genuine symptomatic improvement, such as pain relief, that can be attributed to the placebo effect or a response bias? ...Conversely, those who did not receive any study intervention might be disappointed and disposed to report negative or correct outcomes.
...blinded placebo-controlled trials are able to discriminate real effects from response bias... ...as long as the masking conditions were successful. Response bias may operate to inflate the apparent drug effect (the difference between pretrial baseline and the time of study outcome measurement); likewise, it may account for all or part of the response in the placebo arm. However, in view of randomization and blinding conditions, there is no reason to infer that the effect of response bias is greater in one arm than the other.
Another important aspect of response bias is that it is likely to be closely associated with the same causal factors hypothesized to cause placebo effects: a warm patient-provider interaction and the doctors verbal and nonverbal suggestion of an important beneficial treatment effect. Thus, the more a physician signals friendliness and confident expectation of improvement, the less likely is the patient to disappoint the doctor who is making such an effort. Recent qualitative studies of patients in randomized clinical trials have demonstrated that patients can become dramatically attached to the research team and very committed to the success of a trial [23].
[23] Kaptchuk TJ, Shaw J, Kerr CE, Conboy LA, Kelley JM, Lembo AJ, et al. Maybe I made up the whole thing: placebos and patients experiences in a randomized controlled trial. Cult Med Psychiatry 2009;33:382-412.