Using the Psychiatry Resident-In-Training Examination (PRITE) to Assess the Psychiatry Medical Knowledge Milestones in Psychiatry.

OBJECTIVE: The introduction of the Milestone Project underscored the need for objective assessments of resident progress across the competencies. Therefore, the authors examined the Psychiatry Resident-In-Training Examination (PRITE) utility for measuring improvements in medical knowledge (MK).

METHODS: The authors compared the mean performance for each MK subcompetency by resident year for all residents taking the PRITE from 2015 to 2017 (18,175 examination administrations). In addition, they surveyed psychiatry residency program directors regarding how well they thought they teach these subcompetencies.

RESULTS: Increases in MK subcompetencies by resident year were significant for Psychopathology (p < 0.003), Psychotherapy (p < 0.002), and Somatic Therapies (p < 0.000). Development, Clinical Neuroscience, and Practice of Psychiatry did not show statistically significant differences between postgraduate years. Eighty psychiatry program directors responded to the survey and felt optimistic about their ability to teach the Psychopathology, Psychotherapy, Somatic Therapies, and Practice of Psychiatry subcompetencies.

CONCLUSIONS: The PRITE measured significant improvements in medical knowledge for several of the core subcompetencies. The program director's responses would suggest that the lack of statistically significant differences found for Development and Clinical Neuroscience reflects areas in need of curricular development. The disparity between PRITE performance and program director perception of the Practice of Psychiatry subcompetency may reflect difficulties in defining the scope of this subcompetency. Overall, this suggests that structured examinations help measure improvements in certain subcompetencies and may also help identify curricular needs. However, there may be potential problems with the definition of some subcompetencies.