Evaluation of Patient Satisfaction Surveys in Pediatric Orthopaedics.

BACKGROUND: Patient satisfaction survey scores are increasingly being tied to incentive compensation, impact how we practice medicine, influence decisions on where patients seek care, and in the future may be required for accreditation. The goal of this study is to compare the results of an internal distribution of patient satisfaction surveys at the point of care to responses received by mail in a hospital-based, high-volume pediatric orthopaedic practice.

METHODS: A pediatric outpatient survey is used at our institution to evaluate patient satisfaction. Surveys are randomly mailed out to families seen in our clinic by the survey vendor, and the results are determined on a quarterly basis. We distributed the same survey in a similar manner in our clinic. The results of the surveys, external/mailed (EXM) versus internal/point of care (INP) over the same 3-month time period (second quarter 2013) were compared. The survey questions are dichotomized from an ordinal scale into either excellent (9 to 10) or not excellent (0 to 8) commonly used in patient satisfaction methodology. We evaluated the raw data from the INP surveys for the question on provider rating by evaluating the mean score, the standard excellent response (9 to 10), and an expanded excellent response (8 to 10).

RESULTS: Response rate was 72/469 (15.4%) for EXM, and 231/333 (69.4%) for INP. An excellent response for the "rating your provider" question was 72.2% (EXM) versus 84.8% (INP) (P=0.015). Our analysis of the raw data (INP) has a mean rating of 9.42. The expanded scale (8 to 10) for an excellent response increased the provider rating to 94.4% (P=0.001). Waiting time response within 15 minutes was the only item that correlated with rating of provider (P=0.02). For the majority of the items, the INP responses were consistently higher than the EXM responses, including 6/7 responses that were statistically significant (P<0.05).

CONCLUSIONS: As mandated by the Centers for Medicare and Medicaid Services, patient satisfaction surveys will be important in determining health care outcomes. Properly designed and administered surveys provide robust measures of quality. Our study reinforces methodological concerns about patient satisfaction surveys distributed in a high-volume pediatric subspecialty practice. Further research is needed to evaluate the patients' health care experience and true quality of care in pediatric subspecialty ambulatory settings.