• Welcome to Phoenix Rising!

    Created in 2008, Phoenix Rising is the largest and oldest forum dedicated to furthering the understanding of and finding treatments for complex chronic illnesses such as chronic fatigue syndrome (ME/CFS), fibromyalgia (FM), long COVID, postural orthostatic tachycardia syndrome (POTS), mast cell activation syndrome (MCAS), and allied diseases.

    To become a member, simply click the Register button at the top right.

The control group is out of control.

wdb

Senior Member
Messages
1,392
Location
London
I like the reference to parapsychology

Parapsychologists are constantly protesting that they are playing by all the standard scientific rules, and yet their results are being ignored – that they are unfairly being held to higher standards than everyone else. I’m willing to believe that. It just means that the standard statistical methods of science are so weak and flawed as to permit a field of study to sustain itself in the complete absence of any subject matter.

I've never understood why if a parapsychologist conducts an unblinded subjective trial with positive results it's methodologically flawed worthless nonsense but if a psychologist conducts an unblinded subjective trial with positive results it's wonderful research that should be widely and uncritically reported.
 

A.B.

Senior Member
Messages
3,780
Because psychiatry and psychology have managed to convince the world that they are a science, experts and know what they're doing even without appropriate methodology.
 

chipmunk1

Senior Member
Messages
765
I like the reference to parapsychology

I've never understood why if a parapsychologist conducts an unblinded subjective trial with positive results it's methodologically flawed worthless nonsense but if a psychologist conducts an unblinded subjective trial with positive results it's wonderful research that should be widely and uncritically reported.

the latter is common and normal practice not sure about the former.
 
Messages
3,263
Thanks for this, @Sean, I found it really interesting!

The most relevant part for us is the bit about the researcher allegiance effect in psychotherapy. If you do a metanalysis of all psychotherapy studies meeting certain quality criteria, and also include as a predictor the particular allegiance of the researchers (which therapy they "believe in"), you get a massive effect: Cohen's d = 0.54, which is huge, p > .001.

In other words, you can predict with pretty good accuracy what the results of a psychotherapy study will be just by knowing what the researchers themselves believe in.

@Dolphin posted on this in an earlier thread:

http://forums.phoenixrising.me/inde...-overview-of-reviews-munder-et-al-2013.22466/
 

chipmunk1

Senior Member
Messages
765
what happens if you exclude that effect?

balloon-pop-image.png
 
Last edited:

A.B.

Senior Member
Messages
3,780
what happens if you exclude that effect?

When rheumatologists (?) study CBT and GET for CFS, they find it's harmful (worse physical function and pain scores): Health-related quality of life in patients with chronic fatigue syndrome: group cognitive behavioural therapy and graded exercise versus usual treatment. A randomised controlled trial with 1 year of follow-up.

As for psychotherapy studies, I wonder what happens when researchers study a therapy they dislike / don't believe in.