• Welcome to Phoenix Rising!

    Created in 2008, Phoenix Rising is the largest and oldest forum dedicated to furthering the understanding of, and finding treatments for, complex chronic illnesses such as chronic fatigue syndrome (ME/CFS), fibromyalgia, long COVID, postural orthostatic tachycardia syndrome (POTS), mast cell activation syndrome (MCAS), and allied diseases.

    To become a member, simply click the Register button at the top right.

Example of a potential problem with self-report data: variations between online vs oral answers

Dolphin

Senior Member
Messages
17,567
This is probably a minority interest and has no specific relevance to ME/CFS. But at least a few people are interested in problems with self-reported data.

Free full text: http://www.thepcrj.org/journ/aop/pcrj-2013-01-0005-R1.pdf


Comparison between an online self-administered and an interviewer-administered version of the Asthma Control Questionnaire: a cross-sectional validation study

Prim Care Respir J 2013; 22(x): xx-xx

*Persijn J Honkoop1,2, Rik JB Loijmans3, Evelien H Termeer4, Jiska B Snoeck-Stroband1, Gerben ter Riet3, Tjard RJ Schermer4, Jacob K Sont1 for the ACCURATE Study Group

1 Department of Medical Decision Making, Leiden University Medical Center, The Netherlands 2 Department of Public Health and Primary Care, Leiden University Medical Center, The Netherlands 3 Department of General Practice, Academic Medical Center, Amsterdam, The Netherlands 4 Department of Primary Care, University Medical Center St Radboud, Nijmegen, The Netherlands

Originally received 29th August 2012; resubmitted 9th January 2013; revised 12th February 2013; accepted 13th February 2013

Abstract

Background:

Online self-management programmes for asthma have recently become available.

International guidelines suggest that the Asthma Control Questionnaire (ACQ) can be used in these programmes.

In order to assess the current level of control and guide therapy, the same cut-off values are being used as in conventional asthma management.

However, results might differ between different types of administration of the ACQ.

Aims:

To assess the agreement between an online self-administered version of the ACQ and an interviewer-administered version at a routine visit.

Methods:

Cross-sectional data from primary care asthma patients in the Asthma Control Cost Utility Randomized Trial Evaluation (ACCURATE) trial aged 18–50 years and prescribed inhaled steroids were analysed.

We selected patients who self-administered an ACQ online and subsequently had an ACQ completed by a nurse practitioner within 7 days at a trial-related control visit.

ACQ scores were calculated and agreement assessed by paired t-tests, Pearson's correlation coefficient and a Bland-Altman plot.

Results:

A total of 351 patients were eligible (68% female, mean age 40 years).

The time interval between the two versions was 3.2 days.

There was a significant difference of 0.14 (95% CI 0.09 to 0.20; p<0.001) between the results of the online self-administered ACQ (mean 1.04±0.04) and the interviewer-administered ACQ results (0.90±0.04).

The Pearson correlation coefficient was 0.79.

The limits of agreement (–0.86, 1.14) exceeded the predefined minimal clinically important difference between results (±0.5).

The Bland-Altman plot therefore showed insufficient agreement.

Conclusions:

Assessment of asthma control by the ACQ is influenced by the type of administration.

Our results suggest that better control of asthma is perceived when interacting with a caregiver than by online self-assessment.

© 2013 Primary Care Respiratory Society UK. All rights reserved.

http://dx.doi.org/10.4104/pcrj.2013.00041

Keywords asthma management, monitoring, asthma control, interviewer-administered, self-administered, online