How Well Are We Doing at Teaching Critical Appraisal Skills to Our Residents? A Needs Assessment of Plastic Surgery Journal Club.

Objective: To perform a needs assessment of journal club in plastic surgery residency programs. Specifically, this study focused on potential gaps in journal club associated with teaching and assessing critical appraisal of the literature, an important component of medical education and practice.

Methods: This is a qualitative study that utilized an online survey tool to collect information about the characteristics of journal club in plastic surgery residency programs in both Canada and the United States. Both program directors and residents were surveyed.

Results: When presented with a range of objectives, both program director and resident responses identified that teaching critical appraisal skills was often the main goal of journal club in their program (67.1%). Most trainees perceived that journal club was at least somewhat effective in improving their critical appraisal skills. Despite this perception, many residents felt that they had minimal to no experience in critical appraisal of the literature upon entry into their respective residency programs (46.2%), and only 29.2% indicated that they received formal instruction regarding critical appraisal. Three-quarters of residents indicated that there was no tool provided to aid them in their analysis of the literature. Finally, most residents also responded that they were not assessed objectively with regard to their performance.

Conclusions: Although residents in our study perceive journal club to at least somewhat improve their critical appraisal skills, evidence in the literature has been controversial. It cannot be assumed that residents are learning the skills they need by simply attending and reading the articles associated with journal club. Future study should focus on the best way to meet these objectives.