1. Patients launch a $1.27 million crowdfunding campaign for ME/CFS gut microbiome study.
    Check out the website, Facebook and Twitter. Join in donate and spread the word!
The Chronic Fatigue Initiative and Interview with Mady Hornig
In a follow-up article to the recent IACFS/ME conference presentation in San Francisco, and after speaking at length with Dr. Mady Hornig, 'searcher' delves deeper into the impressive work being completed by the Chronic Fatigue Initiative, and focuses in on those cytokine results ...
Discuss the article on the Forums.

Exploring Case Definition for CFS/ME (Leonard Jason, 2013)

Discussion in 'Latest ME/CFS Research' started by Simon, Dec 13, 2013.

  1. Simon

    Simon

    Messages:
    1,240
    Likes:
    3,705
    Monmouth, UK
    Examining case definition criteria for chronic fatigue syndrome and myalgic encephalomyelitis

    Background: Considerable controversy has transpired regarding the core features of myalgic encephalomyelitis (ME) and chronic fatigue syndrome (CFS). Current case definitions differ in the number and types of symptoms required. This ambiguity impedes the search for biological markers and effective treatments.

    Purpose: This study sought to empirically operationalize symptom criteria and identify which symptoms best characterize the illness.

    Methods: Patients (n = 236) and controls (n  = 86) completed the DePaul Symptom Questionnaire, rating the frequency and severity of 54 symptoms. Responses were compared to determine the threshold of frequency/severity ratings that best distinguished patients from controls. A Classification and Regression Tree (CART) algorithm was used to identify the combination of symptoms that most accurately classified patients and controls.

    Results:
    A third of controls met the symptom criteria of a common CFS case definition when just symptom presence was required; however, when frequency/severity requirements were raised, only 5% met the criteria.

    Employing these higher frequency/severity requirements, the CART algorithm identified three symptoms that accurately classified 95.4% of participants as patient or control: fatigue/extreme tiredness, inability to focus on multiple things simultaneously, and experiencing a dead/heavy feeling after starting to exercise.

    Conclusions
    :

    Minimum frequency/severity thresholds should be specified in symptom criteria to reduce the likelihood of misclassification.

    Future research should continue to seek empirical support of the core symptoms of ME and CFS to further progress the search for biological markers and treatments.
    ----

    The basic finding that symptom frequency and severity are important in separating patients and controls is interesting. In the PACE recovery paper, the authors argued that most of the population had several mecfs symptoms at any time and implied that patients shouldn't get too hung up on such things - though the population study PACE cited was flawed and in any case showed the symptoms only affected daily activity for a small minority of the healthy.
    Last edited: Dec 13, 2013
    biophile, Esther12, WillowJ and 7 others like this.
  2. wdb

    wdb Admin

    Messages:
    803
    Likes:
    551
    London
    Good to see some research being done in that area, it's a shame there are not more detailed results, it would be interesting to look for any sub-groups exclusive to the patients, and also to see if any commonly used criteria are ineffective at discriminating.

    Would also be good to know the criteria used to diagnose the patients as that would presumably have to a large extent dictated the results.
    aimossy likes this.
  3. caledonia

    caledonia

    Messages:
    2,722
    Likes:
    1,314
    Cincinnati, OH, USA
    I'm confused. How were the controls picked out? Aren't controls usually healthy controls? If so, why would a few of them show up with ME/CFS?
  4. wdb

    wdb Admin

    Messages:
    803
    Likes:
    551
    London
    They were healthy controls, I think that is one of the points that they are making is that some diagnostic criteria are so loose particularly when only symptom presence is measured that even healthy people sometimes meet those criteria.
    Valentijn likes this.
  5. Simon

    Simon

    Messages:
    1,240
    Likes:
    3,705
    Monmouth, UK
    Commentary on full text

    The stuff in large quote boxes can be skipped if you don't want too much detail.

    Symptom severity matters: many healthy controls have enough mild symptoms for ME/CFS
    Jason points out the the three case definitions don't define individual symptom severity or frequency (though ICC requires overall symptom severity to require a 50% reduction in activity levels) and it turns out that a good chunk of healthy controls have enough mild, infrequent symptoms to meet the case definitions. Requiring symptoms to be at least moderate, present for at least half the time mean only a small minority of healthy controls would meet the case definitions:

    % controls meeting case definition with mild v moderate symptoms
    Fukuda: 34% mild; 5% >= moderate
    CCC: 21% mild; 4%
    ICC: 15% mild; 4%

    The authors acknowledge a significant problem with the DSQ approach, ie that it doesn't take account of acitivity levels:
    Given that most patients use pacing specifically to minimise symptom severity and frequency this is an important issue.

    The paper also points out that at this higher symptom severity/frequency threshold less than half of CCC and ICC patients have most of the individual immune, neuroendocrine and autonomic symptoms. In contrast, most have almost all of the sleep, PEM and neurocognitive symptoms.

    end of part 1
    Last edited: Dec 17, 2013
    Ruthie24, WillowJ, Firestormm and 3 others like this.
  6. Simon

    Simon

    Messages:
    1,240
    Likes:
    3,705
    Monmouth, UK
    At the heart of this paper is a data mining technique called CART: Classification and Regression Tree, which was used to classify individuals as "CFS" or "Controls" based on symptom data. A good explanation of how CARTs work comes from Wikipedia:
    CART model predicts CFS using three symptoms
    Using a CART, and couting symptoms only when they were at least moderate and present for at least half the time, just 3 symptoms (out of 54) were able to predict if a person was a CFS case or a heathy control:
    - fatigue or extreme tiredness
    - inability to focus on more than one thing at a time [neurocognitive problem]
    - experiencing a dead or heavy feeling after starting to exercise ["Post-exertional Malaise" problem]

    The CART model classified 95% of patients and controls correctly (nb these cases had originally been diagnosed as either Fukuda or ICC patients). There is always a risk of 'overfitting' a model to any particular dataset so the authors randomly split the sample. 66% of patients and controls made up a "Training Set" that was used to develop the model. The 95% accuracy rate was on the remaining "Test" set. This reduces the influence of any overfitting, but ideally the CART model would also be tested on a completely independent sample too.

    A "dead or heavy feeling after starting exercise" and even "inability to focus on more than one thing at a time" might not seem like the most obvious cardinal symptoms to define mecfs. However, the dead/heavy feeling is one of several symptoms in the DSQ that captures PEM and not multi-tasking is one of several neurocognitive symptoms, and a feature of CART models is that the precise symptom they pick can be a bit quirky (and perhaps is down to overfitting). But very similar results would probably come from using a model with different PEM or neurocognitive symptoms, because the individual PEM/neurocogitive symptoms are likely to be highly correlated with one another.

    Case for a few core symptoms?
    Leonard Jason has long argued for focusing on a few core symptoms ie creating a tighter definition by insisting on a few core symptoms (none are mandatory in Fukuda so you can be diagnosed without PEM and without neurocog symptoms) - as opposed to more mandatory symptoms. CCC and ICC effectively do both. This paper revisits the argument:
    The danger with adding a requirement for many symptoms is that it may inadvertently select pateints with more psychiatric symptoms. A recent study by Jason et al found just this, but that study also found a higher level of disability - and more psychiatric symptoms may just be a response to more impairment.

    Intriguingly, a submitted article from Jason (presumably using the same data as this new study) supports a case definition based on PEM, Neurocognitive problems and a third factor encompassing a host of other symptoms covered by the CCC and ICC to various degrees:
    Factor analysis basically mines the data to find common cluster, where each 'factor' is made up of a group of symptoms that cluster together.

    Congratulations to those who made it this far, but these posts are a lot shorter than the full text ...
    Last edited: Dec 18, 2013
    SickOfSickness, Ruthie24, SOC and 4 others like this.
  7. Firestormm

    Firestormm Senior Member

    Messages:
    5,819
    Likes:
    5,941
    Cornwall England
    Thanks very much @Simon

    So, then. Jason at least would say that there is a need for a new definition. Interesting in light of the IOM study. I do hope they take his stuff on board. Shame he isn't on the panel.

    I reviewed his earlier paper on one of the IOM threads. I think this move towards frequency and severity of core symptoms has been something he's been exploring for a while. It might have been the paper you linked to - I'd have to check.

    My question then is this: in the UK we have 3 or 4 (depending) severities once you have received a diagnosis - I wonder if this would impact on those?

    Mild, Moderate, Severe, Very Severe

    I mean Jason's method must surely help to categorise the degree to which a patient is affected by their condition - although he didn't use it for that in this study the results must indicate who is at the top end and who at the bottom, in terms of how their are affected.

    Edit: That 2011 paper was the one I looked at. I looked because he seemed to be addressing issue of operationalising the definitions which is something I believe IOM has been charged with. I am still unsure though if this is what they mean by operationalising - but still it is an interesting means of determining suitability of diagnosis. I am not though sure how reported symptoms might stack up against eventual biomarkers.
    Last edited: Dec 17, 2013
  8. WillowJ

    WillowJ Senior Member

    Messages:
    2,890
    Likes:
    2,287
    WA, USA
    Jason also has a 2010 paper which discusses the importance of symptom frequency and severity. The full text is free at this time.
    Simon likes this.
  9. Simon

    Simon

    Messages:
    1,240
    Likes:
    3,705
    Monmouth, UK
    That might be the most important issue. Although I like the idea of focusing on a few mandatory core symptoms, I'm not convinced there is any good reason to create a new case definition (IOM included) until we have a better handle on the biology.

    The argument goes that without the right case definiton we won't have 'pure' cohorts and so have no chance with the biology anyway. But personally I think the most successful approach is likely to be with Big Data ('omics including genomics, gene expression, proteomics, metabolomics, and huge cohorts of the sort that Stephen Holgate has talked about. I think only such a Big approach is likely to reveal the real subtypes of me cfs -it's an approach already being used in cancer, eg this recent Nature paper.

    We do have these categories? I didn't realise there was anything so fixed. But the best way to assess overall severity is probably with overall measures eg SF36 Functioning scales or Charles Shepherd's or AYME's (developed with patients). Rather than, say, summing up the individual symptoms and trying to get a total symptom burden.
    Last edited: Dec 17, 2013
    Valentijn, Firestormm and WillowJ like this.

See more popular forum discussions.

Share This Page