Journal of Manipulative and Physiological Therapeutics
Volume 33, Issue 1 , Pages 29-41 , January 2010

Development of a Quality Checklist Using Delphi Methods for Prescriptive Clinical Prediction Rules: The QUADCPR

  • Chad Cook, PT, PhD, MBA

      Affiliations

    • Associate Professor, Department of Community and Family Medicine, Duke University Health System, Durham, NC
    • Corresponding Author InformationSubmit requests for reprints to: Chad Cook, PT, PhD, MBA, Associate Professor, Department of Community and Family Medicine, Department of Surgery, Duke University Health System, 2200 W Main St, Suite A-210, DUMC Box 104002, Durham, NC 27708.
  • ,
  • Jean-Michel Brismée, PT, ScD

      Affiliations

    • Associate Professor, Doctor of Science Program in Physical Therapy, Texas Tech University Health Sciences Center Lubbock, TX
  • ,
  • Ricardo Pietrobon, MD, PhD, MBA

      Affiliations

    • Associate Professor and Associate Vice-Chair of Surgery, Duke University Health System, Durham, NC
    • Associate Professor, Duke/NUS Singapore
  • ,
  • Philip Sizer Jr., PT, PhD

      Affiliations

    • Professor and Program Director, Doctor of Science Program in Physical Therapy Director, Clinical Musculoskeletal Research Laboratory, Texas Tech University Health Sciences Center Lubbock, TX
  • ,
  • Eric Hegedus, PT, DPT, MHSc

      Affiliations

    • Associate Professor, Department of Community and Family Medicine, Duke University Health System, Durham, NC
  • ,
  • Daniel L. Riddle, PT, PhD

      Affiliations

    • Professor and Assistant Department Chair, Department of Physical Therapy, Virginia Commonwealth University, Richmond, VA

Received 15 July 2009 ,Revised 28 July 2009

References 

  1. Beattie P, Nelson R. Clinical prediction rules: what are they and what do they tell us?. Aust J Physiother. 2006;52:157–163
  2. Brehaut JC, Stiell IG, Visentin L, Graham ID. Clinical decision rules “in the real world”: how a widely disseminated rule is used in everyday practice. Acad Emerg Med. 2005;12:948–956
  3. Flynn T, Fritz JM, Whitman J, et al. A clinical prediction rule for classifying patients with low back pain who demonstrate short-term improvement with spinal manipulation. Spine. 2002;27:2835–2843
  4. Childs JD, Fritz JM, Flynn TW, et al. A clinical prediction rule to identify patients with low back pain most likely to benefit from spinal manipulation: a validation study. Ann Intern Med. 2004;141:920–928
  5. Hicks GE, Fritz JM, Delitto A, McGill SM. Preliminary development of a clinical prediction rule for determining which patients with low back pain will respond to a stabilization exercise program. Arch Phys Med Rehabil. 2005;86:1753–1762
  6. Hancock MJ, Maher CG, Latimer J, Herbert RD, McAuley JH. Independent evaluation of a clinical prediction rule for spinal manipulative therapy: a randomised controlled trial. Eur Spine J. 2008;17:936–943
  7. Cleland JA, Childs JD, Fritz JM, Whitman JM, Eberhart SL. Development of a clinical prediction rule for guiding treatment of a subgroup of patients with neck pain: use of thoracic spine manipulation, exercise, and patient education. Phys Ther. 2007;87:9–23
  8. Tseng YL, Wang WT, Chen WY, Hou TJ, Chen TC, Lieu FK. Predictors for the immediate responders to cervical manipulation in patients with neck pain. Man Ther. 2006;11:306–315
  9. Fernandez-de-las-Penas C, Cleland JA, Caudrado ML, Pareja JA. Predictor variables for identifying patients with chronic tension-type headache who are likely to achieve short term success with muscle trigger point therapy. Cephalgia. 2008;38:264–275
  10. Lesher JD, Sutlive TG, Miller GA, Chine NJ, Garber MB, Wainner RS. Development of a clinical prediction rule for classifying patients with patellofemoral pain syndrome who respond to patellar taping. J Orthop Sports Phys Ther. 2006;36:854–866
  11. Currier LL, Froehlich PJ, Carow SD, et al. Development of a clinical prediction rule to identify patients with knee pain and clinical evidence of knee osteoarthritis who demonstrate a favorable short-term response to hip mobilization. Phys Ther. 2007;87:1106–1119
  12. Iverson CA, Sutlive TG, Crowell MS. Lumbopelvic manipulation for the treatment of patients with patellofemoral pain syndrome: development of a clinical prediction rule. J Orthop Sports Phys Ther. 2008;38:297–309[discussion 309-12]
  13. Vicenzino B, Smith D, Cleland J, Bisset L. Development of a clinical prediction rule to identify initial responders to mobilization with movement and exercise for lateral epicondylalgia. Man Ther. 2008;[Epub ahead of print]
  14. Vicenzino B, Collins N, Cleland J, McPoil T. A clinical prediction rule for identifying patients with patellofemoral pain. Br J Sports Med. 2008;[Epub ahead of print]
  15. Alghamdi AA, Davis A, Brister S, Corey P, Logan A. Development and validation of Transfusion Risk Understanding Scoring Tool (TRUST) to stratify cardiac surgery patients according to their blood transfusion needs. Transfusion. 2006;46:1072–1074
  16. Van Belle A, Buller HR, Huisman MV, et al. Christopher Study Investigators. Effectiveness of managing suspected pulmonary embolism using an algorithm combining clinical probability, d-dimer testing, and computed tomography. JAMA. 2006;295:172–179
  17. Dunning J, Au J, Kalkat M, Levine A. A validated rule for predicting patients who require prolonged ventilation post cardiac surgery. Eur J Cardiothorac Surg. 2003;24:270–276
  18. Fischer Walker CL, Rimoin AW, Hamza HS, Steinhoff MC. Comparison of clinical prediction rules for management of pharyngitis in setting with limited resources. J Pediatr. 2006;149:64–71
  19. Fischer JE, Steiner F, Zucol F, et al. Use of simple heuristics to target macrolide prescription in children with community-acquired pneumonia. Arch Pediatr Adolesc Med. 2002;156:1005–1008
  20. Childs JD, Cleland JA. Development and application of clinical prediction rules to improve decision making in physical therapist practice. Phys Ther. 2006;86:122–131
  21. Hier DB, Edlestein G. Deriving clinical prediction rules from stroke outcome research. Stroke. 1991;22:1431–1436
  22. Wasson JH, Sox HC, Neff RK, Goldman L. Clinical prediction rules: applications and methodological standards. New Engl J Med. 1985;313:793–799
  23. Toll DB, Janssen LJM, Vergouwe Y, Moons KGM. Validation, updating and impact of clinical prediction rules: a review. J Clin Epi. 2008;61:1085–1094
  24. Casali PG, Licitra L, Bruzzi P. QUOROM and the search for an updated ‘clinical method’ in the era of evidence-based medicine. Ann Oncol. 2000;11:923–925
  25. Smidt N, Rutjes AW, van der Windt DA. Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies. BMC Med Res Methodol. 2006;6:12
  26. Altman DG, Schulz KF. Statistics notes: concealing treatment allocation in randomised trials. BMJ. 2001;323:446–447
  27. Moher D, Schulz KR, Altman DG CONSORT GROUP (Consolidated Standards of Reporting Trials). The CONSORT statement; revised recommendations for improving the quality of reports of parallel-group randomized controlled trials. Ann Intern Med. 2001;134:657–662
  28. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative. Ann Intern Med. 2003;138:40–44
  29. Whiting P, Rutjes AV, Reitsma JB, Bossuyt PM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003;3:25
  30. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomized controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999;354:1896–1900
  31. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283:2008–2012
  32. Vandenbroucke JP, von Elm E, Altman DG, et al. STROBE initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Ann Intern Med. 2007;147:163–194
  33. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6:e34
  34. Beneciuk JM, Bishop M, George SZ. Clinical prediction rules for physical therapy interventions: a systematic review. Phys Ther. 2009;89:114–124
  35. May S, Rosedale R. Prescriptive clinical prediction rules in back pain research: a systematic review. J Man Manipulative Ther. 2009;17:36–45
  36. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use (4th ed.) Oxford: Oxford University Press; 2008.
  37. Knottnerus JA. Diagnostic prediction rules: principles, requirements, and pitfalls. Prim Care. 1995;22:341–363
  38. Laupacis A, Sekar M, Stiell IG. Clinical prediction rules: a review and suggested modifications of methodological standards. JAMA. 1997;277:488–494
  39. McConnochie KM, Roghmann KJ, Pasternack J. Developing clinical prediction rules and evaluating observational patterns using categorical clinical markers. Med Decis Making. 1993;13:30–42
  40. Norman GR, Stratford P, Regehr G. Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol. 1997;50:869–879
  41. Schmitt JC, Di Fabio RP. Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. J Clin Epidemiol. 2004;57:1008–1018
  42. Schmitt JC, Di Fabio RP. The validity of prospective and retrospective global change criterion measures. Arch Phys Med Rehabil. 2005;86:2270–2276
  43. Concato J, Feinstein AR, Holford TR. The risk of determining risk with multivariate methods. Ann Intern Med. 1993;118:201–210
  44. Blackmore CC. Clinical prediction rules in trauma imaging: who, how, and why. Radiology. 2005;235:371–374
  45. Jaeschke R, Guyatt GH, Sackett DL. Users guide to the medical literature. III. How to use an article about a diagnostic test. What are the results and will they help me?. JAMA. 1994;271:703–707
  46. McGinn TG, Guyatt GH, Wyer PC, et al. Evidence based medicine working group. User's guides to the medical literature. XXII. How to use articles about clinical decision rules. JAMA. 2000;284:79–84
  47. Reilly BM, Evans AT. Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med. 2006;144:201–209
  48. Powell C. The Delphi technique: myths and realities. J Advanced Nurs. 2003;41:376–382
  49. Fink A, Kosecoff J, Chassin M, Brook R. Consensus methods: characteristics and guidelines for use. Am J Pub Health. 1984;74:979–983
  50. Dawson S, Barker J. Hospice and palliative care: a Delphi survey of occupational therapists roles and training needs. Aust Occupational Ther J. 1995;2:119–127
  51. Distler O, Behrens F, Pittrow D, et al. EPOSS-Omeract Group. Defining appropriate outcome measures in pulmonary arterial hypertension related to systemic sclerosis: a Delphi consensus study with cluster analysis. Arthritis Rheum. 2008;59:867–875[Erratum in: Arthritis Rheum. 2008;59(8):1202]
  52. Wilson MR, Lee PP, Weinreb RN, Lee BL, Singh K. Glaucoma Modified RAND-Like Methodology Group. A panel assessment of glaucoma management: modification of existing RAND-like methodology for consensus in ophthalmology. Part I: methodology and design. Am J Ophthalmol. 2008;145:570–574
  53. Adler M, Ziglio E. Gazing into the oracle. Bristol (Pa): Jessica Kingsley Publishers; 1996;
  54. Cook C, Brismée JM, Fleming R, Sizer PS. Identifiers suggestive of clinical cervical spine instability: a Delphi study of physical therapists. Phys Ther. 2005;85:895–906
  55. Cook C, Brismée JM, Sizer PS. Subjective and objective descriptors of clinical lumbar spine instability: a Delphi study. Man Ther. 2006;11:11–21
  56. Dillman D. Mail and Internet surveys. The tailored design method. 2nd ed.. New York: John Wiley and Sons; 2000;
  57. Lopopolo R. Hospital restructuring and the changing nature of the physical therapist's role. Phys Ther. 1999;79:171–185
  58. Binkley J, Finch E, Hall J, Black T, Gowland C. Diagnostic classification of patients with low back pain: report on a survey of physical therapy experts. Phys Ther. 1993;73:138–150
  59. Shah A, Jacobs DO, Martins H, Harker M, Menezes A, McCready M, et al. DADOS-Survey: an open-source application for CHERRIES-compliant Web surveys. BMC Med Inform Decis Mak. 2006;6:34
  60. Cleary K. Using the Delphi process to reach consensus. J Cardiopulm Phys Ther. 2001;1:20–23
  61. Hancock M, Herbert RD, Maher CG. A guide to interpretation of studies investigating subgroups of responders to physical therapy interventions. Phys Ther. 2009;89:698–704
  62. Stheeman S, van't Hof M, Mileman P, van der Stelt P. Use of the Delphi technique to determine standards for quality assessment in diagnostic radiology. Community Dent Health. 1995;12:194–199
  63. Begg C, Metz C. Consensus diagnoses and “gold standards”. Med Decis Making. 1990;10:24–29
  64. Altman R. Criteria for the classification of osteoarthritis of the knee and hip. Scand J Rheumatol Suppl. 1987;65:31–39
  65. Grahm B, Regehr G, Wright J. Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol. 2003;56:1150–1156

PII: S0161-4754(09)00306-6

doi: 10.1016/j.jmpt.2009.11.010

Journal of Manipulative and Physiological Therapeutics
Volume 33, Issue 1 , Pages 29-41 , January 2010