Achieving valid patient-reported outcomes measurement: a lesson from fatigue in multiple sclerosis

Jeremy Hobart, Stefan Cano, Rachel Baron, Alan Thompson, Steven Schwid, John Zajicek, David Andrich

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)


BACKGROUND: The increasing influence of patient-reported outcome (PRO) measurement instruments indicates their scrutiny has never been more crucial. Above all, PRO instruments should be valid: shown to assess what they purport to assess.

OBJECTIVES: To evaluate a widely used fatigue PRO instrument, highlight key issues in understanding PRO instrument validity, demonstrate limitations of those approaches and justify notable changes in the validation process.

METHODS: A two-phase evaluation of the 40-item Fatigue Impact scale (FIS): a qualitative evaluation of content and face validity using expert opinion (n=30) and a modified Delphi technique; a quantitative psychometric evaluation of internal and external construct validity of data from 333 people with multiple sclerosis using traditional and modern methods.

RESULTS: Qualitative evaluation did not support content or face validity of the FIS. Expert opinion agreed with the subscale placement of 23 items (58%), and classified all 40 items as being non-specific to fatigue impact. Nevertheless, standard quantitative psychometric evaluations implied, largely, FIS subscales were reliable and valid.

CONCLUSIONS: Standard quantitative 'psychometric' evaluations of PRO instrument validity can be misleading. Evaluation of existing PRO instruments requires both qualitative and statistical methods. Development of new PRO instruments requires stronger conceptual underpinning, clearer definitions of the substantive variables for measurement and hypothesis-testing experimental designs.

Original languageEnglish
Pages (from-to)1773-83
Number of pages11
JournalMultiple Sclerosis Journal
Issue number13
Publication statusPublished - Nov 2013


  • Adult
  • Aged
  • Aged, 80 and over
  • Cognition
  • Disability Evaluation
  • Fatigue
  • Female
  • Humans
  • Male
  • Middle Aged
  • Multiple Sclerosis
  • Neurologic Examination
  • Patient Outcome Assessment
  • Patient Satisfaction
  • Physical Endurance
  • Psychometrics
  • Reproducibility of Results
  • Self Report
  • Social Behavior
  • Treatment Outcome
  • Young Adult


Dive into the research topics of 'Achieving valid patient-reported outcomes measurement: a lesson from fatigue in multiple sclerosis'. Together they form a unique fingerprint.

Cite this