Add like
Add dislike
Add to saved papers

Development and Evaluation of a New Formative Assessment of Surgical Performance.

BACKGROUND: Formative assessment of operative performance is a mandatory part of surgical training. Engagement with assessment is limited in part by the time-consuming nature and the high perceived stakes of current assessment tools.

OBJECTIVES: Our aims were to develop and collect validity evidence for a new operative assessment tool that addresses barriers to assessment that current trainers and trainees experience.

METHODS: We developed the Generic Operative Supervised Learning Event (GOSLE). Orthopedic trainees were invited to complete GOSLEs with their trainers after surgical procedures. Experienced consultants assessed videotaped operations performed by trainees using the GOSLE. Validity evidence for content, relationships to other scores, internal structure, response process, and consequences of testing were evaluated.

RESULTS: A total of 250 GOSLEs were completed. A strong correlation was found between the GOSLE scores and the Procedure-Based Assessment ratings (r = 0.87, p < 0.001). Rasch analysis confirmed satisfactory internal structure of the rating scale, with sequential increases in rating as performance improved. The reproducibility coefficient was 0.88, with 10 assessments of the same trainee who has to achieve a reliability coefficient of 0.8. Over 90% of users found the GOSLE easy to use, with most preferring it to other assessment methods. Feedback quality was higher using the GOSLE than with current assessments.

CONCLUSION: We have collected validity evidence across multiple domains in support of the GOSLE. Its psychometric performance is comparable to that of current assessments. It is preferred by trainers and trainees over existing assessments. It stimulates high-quality, actionable feedback which better supports formative assessment. By addressing issues experienced with existing assessments, we expect engagement among users to be high.

Full text links

We have located links that may give you full text access.
Can't access the paper?
Try logging in through your university/institutional subscription. For a smoother one-click institutional access experience, please use our mobile app.

For the best experience, use the Read mobile app

Mobile app image

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app

All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.

By using this service, you agree to our terms of use and privacy policy.

Your Privacy Choices Toggle icon

You can now claim free CME credits for this literature searchClaim now

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app