Abstract
Objectives
The purpose of this article is to describe how we designed patient survey instruments
to ensure that patient data about preferences and experience could be included in
appropriateness decisions. These actions were part of a project that examined the
appropriateness of spinal manipulation and mobilization for chronic low back pain
and chronic neck pain.
Methods
We conducted focus groups, cognitive interviews, a literature review of measures in
prior chiropractic and complementary and integrative health research, and a pilot
study to develop questionnaires of patient preferences, experiences, values, and beliefs.
Results
Questionnaires were administered online to 2024 individuals from 125 chiropractic
clinics. The survey included 3 long questionnaires and 5 shorter ones. All were administered
online. The baseline items had 2 questionnaires that respondents could complete in
different sittings. Respondents completed shorter biweekly follow-ups every 2 weeks
and a final questionnaire at 3 months. The 2 initial questionnaires had 81 and 140
items, the 5 biweekly follow-up questionnaires had 37 items each, and the endline
questionnaire contained 121 items. Participants generally responded positively to
the survey items, and 91% of the patients who completed a baseline questionnaire completed
the endpoint survey 3 months later. We used “legacy” measures, and we also adapted
measures and developed new measures for this study. Preliminary assessment of reliability
and validity for a newly developed scale about coping behaviors indicates that the
items work well together in a scale.
Conclusions
This article documents the challenges and the efforts involved in designing data collection
tools to facilitate the inclusion of patient data into appropriateness decisions.
Key Indexing Terms
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Journal of Manipulative & Physiological TherapeuticsAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- (Available at:)https://www.pcori.org/Date accessed: November 19, 2018
- Researching the appropriateness of care in the complementary and integrative health professions: part I.J Manipulative Physiol Ther. 2018; 41: 800-806
- SEaRCH™ expert panel process: streamlining the link between evidence and practice.BMC Res Notes. 2016; 9: 16
- The RAND/UCLA Appropriateness Method User’s Manual.RAND Corporation, Santa Monica, CA2001
- Determining the Appropriateness of Spinal Manipulation and Mobilization for Chronic Low Back Pain: Indications and Ratings by a Multidisciplinary Expert Panel.RAND Corp, Santa Monica, CA2018
- Determining the Appropriateness of Spinal Manipulation and Mobilization for Chronic Neck Pain: Indications and Ratings by a Multidisciplinary Expert Panel.RAND Corp, Santa Monica, CA2018
- Prospects and challenges in using patient-reported outcomes in clinical practice.Qual Life Res. 2008; 17: 1297-1302
- Patient-reported outcomes: a new era in clinical research.Pers Clin Res. 2011; 2: 137-144
- Toward a better understanding of patient-reported outcomes in clinical practice.Am J Manag Care. 2014; 20: 281-283
- Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations.Qual Life Res. 2012; 21: 1305-1314
- Measures in chiropractic research: choosing patient-based outcome assessments.J Manipulative Physiol Ther. 2008; 31: 355-375
- Assessing quality of life in clinical research: from where have we come and where are we going?.J Clin Epidemiol. 1999; 52: 355-363
- Health and quality-of-life-outcomes: the role of patient-reported measures.in: Outcomes Measurement in the Human Services: Cross-Cultural Issues and Methods in the Era of Health Reform. 2nd ed. NASM Press, Washington, DC2011
- Measuring health-related quality of life and other outcomes.in: Kominski GG Changing the U.S. Health Care System. 4th ed. Jossey-Bass, San Francisco, CA2014: 307-341
- Correlation of the Patient Reported Outcomes Measurement Information System with legacy outcomes measures in assessment of response to lumbar transforaminal epidural steroid injections.Am J Neuroradiol. 2015; 36: 594
- PROMIS and legacy measures compared in a supportive care intervention for breast cancer patients and caregivers: experience from a randomized trial.Psychooncology. 2018; 27: 2265-2273
- PROMIS depression measures perform similarly to legacy measures relative to a structured diagnostic interview for depression in cancer patients.Qual Life Res. 2018; 27: 1357-1367
- Techniques to identify themes.Field Methods. 2003; 15: 85-109
- Development of the NIH Patient-Reported Outcomes Measurement Information System (PROMIS) Gastrointestinal Symptom Scales.Am J Gastroenterol. 2014; 109: 1804-1814
- Child and adolescent perceptions of oral health over the life course.Qual Life Res. 2015; 24: 2739-2751
- The Oswestry Low Back Pain Disability Questionnaire.Physiotherapy. 1980; 66: 271-273
- The Oswestry Disability Index.Spine. 2000; 25: 2940-2953
- The Neck Disability Index: a study of reliability and validity.J Manipulative Physiol Ther. 1991; 14: 409-415
- Patient-Reported Outcomes Measurement Information Systems (PROMIS®).(Available at:)https://commonfund.nih.gov/promis/indexDate accessed: November 19, 2018
- The measurement of clinical pain intensity: a comparison of six methods.Pain. 1986; 27: 117-126
- Relationship of pain-specific beliefs to chronic pain adjustment.Pain. 1994; 57: 301-309
- Development and initial validation of a scale to measure self-efficacy beliefs in patients with chronic pain.Pain. 1995; 63: 77-83
- A mind-body program for older adults with chronic low back pain: a randomized clinical trial.JAMA Intern Med. 2016; 176: 329-337
- Unlearning chronic pain: a randomized controlled trial to investigate changes in intrinsic brain connectivity following cognitive behavioral therapy.Neuroimage Clin. 2014; 5: 365-376
- Effect of Iyengar yoga therapy for chronic low back pain.Pain. 2005; 115: 107-117
- Psychometric properties of the credibility/expectancy questionnaire.J Behav Ther Exp Psychiatry. 2000; 31: 73-86
- The Center for Epidemiologic Studies Depression Scale Revised.(Available at:) (Accessed October 23, 2018)
- Commentary: copyright restrictions versus open access to survey instruments.Med Care. 2018; 56: 107-110
- Improving Survey Questions: Design and Evaluation.SAGE Publications, Thousand Oaks, CA1995
Johnson RL, Morgan GB. Survey Scales: A Guide to Development, Analysis, and Reporting. New York, NY: Guilford Publications; 2016.
Willis GB, Artino AR Jr. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Grad Med Educ 2013;5(3):353-356.
- Identification of strategies used to cope with chronic pain in older persons receiving primary care from a Veterans Affairs Medical Center.J Am Geriatr Soc. 2004; 52: 950-956
- Patterns of coping among persons with HIV infection: configurations, correlates, and change.Am J Community Psychol. 2003; 32: 187-204
- Report of the NIH Task Force on research standards for chronic low back pain.Phys Ther. 2015; 95: e1-e18
- Approaches to Social Research. 5th ed.Oxford University Press, Oxford, England2010
- Coefficient alpha and the internal structure of tests.Psychometrika. 1951; 16: 297-334
- An evaluation of a cognitive theory of response-order effects in survey measurement.Public Opin Q. 1987; 51: 201-219
- A method for the detailed assessment of the appropriateness of medical technologies.Int J Technol Assess Health Care. 2009; 2: 53-63
- Appropriateness in health care services: report on a WHO workshop, 23–25 March 2000. Koblenz, Germany.WHO Regional Office for Europe, Copenhagen, Denmark2000
- Grading the severity of chronic pain.Pain. 1992; 50: 133-149
- Can we screen for problematic back pain? A screening questionnaire for predicting outcome in acute and subacute back pain.Clin J Pain. 1998; 14: 209-215
- Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis.Arthritis Rheum. 1989; 32: 37-44
- Do attitudes and beliefs influence work loss due to low back trouble?.Occup Med. 1996; 46: 25-32
- A new approach to defining functional ability in ankylosing spondylitis: the development of the Bath Ankylosing Spondylitis Functional Index.J Rheumatol. 1994; 21: 2281-2285
- An inventory for measuring clinical anxiety: psychometric properties.J Consult Clin Psychol. 1988; 56: 893
- An inventory for measuring depression.Arch Gen Psychiatry. 1961; 4: 561-571
- Perceived exertion as an indicator of somatic stress.Scand J Rehabil Med. 1970; 2: 92-98
- The Bournemouth Questionnaire: a short-form comprehensive outcome measure. I. Psychometric properties in back pain patients.J Manipulative Physiol Ther. 1999; 22: 503-510
- The CES-D scale: a self-report depression scale for research in the general population.Appl Psychol Meas. 1977; 1: 385-401
- Acceptance of chronic pain: component analysis and a revised assessment method.Pain. 2004; 107: 159-166
- The chronic pain coping inventory: development and preliminary validation.Pain. 1995; 60: 203-216
- The use of coping strategies in chronic low back pain patients: relationship to patient characteristics and current adjustment.Pain. 1983; 17: 33-44
- Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder, and head).Am J Ind Med. 1996; 29: 602-608
- A scaled version of the General Health Questionnaire.Psychol Med. 1979; 9: 139-145
- Generalized self-efficacy scale.in: Weinman J Wright S Johnston M Measures in Health Psychology: A User’s Portfolio. Causal and Control Beliefs. Windsor, UK: NFER-NELSON. 1995: 35-37
- Capturing the patient’s view of change as a clinical outcome measure.JAMA. 1999; 282: 1157-1162
- Measurement of health status: ascertaining the minimal clinically important difference.Control Clin Trials. 1989; 10: 407-415
- Goals matter: both achievement and pain-avoidance goals are associated with pain severity and disability in patients with low back and upper extremity pain.Pain. 2011; 152: 1382-1390
- Health-related quality-of-life measures--United States, 1993.MMWR Morb Mortal Wkly Rep. 1995; 44: 195-200
- The role of perceived injustice in the experience of chronic pain and disability: scale development and validation.J Occup Rehabil. 2008; 18: 249-261
- Development and preliminary validation of the MedRisk instrument to measure patient satisfaction with chiropractic care.J Manipulative Physiol Ther. 2011; 34: 23-29
- Development and validation of the health locus of control (HLC) scale.J Consult Clin Psychol. 1976; 44: 580
- The Northwick Park Neck Pain Questionnaire, devised to measure neck pain and disability.Rheumatology. 1994; 33: 469-474
- The Pain Catastrophizing Scale: development and validation.Psychol Assess. 1995; 7: 524
- The Pain Disability Index: factor structure and normative data.Arch Phys Med Rehabil. 1994; 75: 1082-1086
- The pain self-efficacy questionnaire: taking pain into account.Eur J Pain. 2007; 11: 153-163
- Further validation of the Patient-Practitioner Orientation Scale (PPOS) from recorded visits for back pain.Patient Educ Couns. 2012; 89: 288-291
- Collaborative decision making in nursing practice: a theoretical framework.in: Chinn P Advances in Nursing Theory Development. Aspen Systems, Rockville, MD1983: 271-283
- Assessing disability and change on individual patients: a report of a patient specific measure.Physiother Canada. 1995; 47: 258-263
- Measuring perceived harmfulness of physical activities in patients with chronic low back pain: the Photograph Series of Daily Activities—short electronic version.J Pain. 2007; 8: 840-849
- The Psychological Inflexibility in Pain Scale (PIPS)–Statistical properties and model fit of an instrument to assess change processes in pain related disability.Eur J Pain. 2010; 14: 771.e1-771.e14
- The Quebec Back Pain Disability Scale. Measurement properties.Spine. 1995; 20: 341-352
- The Roter interaction analysis system (RIAS): utility and flexibility for analysis of medical interactions.Patient Educ Couns. 2002; 46: 243-251
- Role of self-efficacy in rehabilitation outcome among chronic low back pain patients.J Couns Psychol. 1993; 40: 335
- The structure and properties of the sense of coherence scale.Soc Sci Med. 1993; 36: 725-733
- Deriving a preference-based single index from the UK SF-36 Health Survey.J Clin Epidemiol. 1998; 51: 1115-1128
- Development of a shoulder pain and disability index.Arthritis Rheum. 1991; 4: 143-149
Brewer B, Van Raalte J, Petitpas A, Sklar J, Ditmar T. A brief measure of adherence during sport injury rehabilitation sessions. J Appl Sport Psychol 1995;7(suppl):S44.
- Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance.Pain. 1995; 62: 363-372
- Development of a questionnaire for the assessment of active and passive coping strategies in chronic pain patients.Pain. 1987; 31: 53-64
- Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee.J Rheumatol. 1988; 15: 1833-1840
- Development and validation of the Working Alliance Inventory.J Couns Psychol. 1989; 36: 223
- A self-rating depression scale.Arch Gen Psychiatry. 1965; 12: 63-70
Article info
Publication history
Published online: June 27, 2019
Accepted:
February 7,
2019
Received in revised form:
December 28,
2018
Received:
December 11,
2018
Identification
Copyright
© 2019 by National University of Health Sciences.
