Journal of Educational Evaluation for Health Professions

PURPOSE: This study conducted a conceptual analysis of gamification in healthcare utilizing Rogers' evolutionary concept analysis methodology to identify its attributes and provide a method for its applications in the healthcare field. Gamification has recently been used as a health intervention and education method, but the concept is used inconsistently and confusingly. METHODS: A literature review was conducted to derive definitions, surrogate terms, antecedents, influencing factors, attributes (characteristics with dimensions and features), surrogate concepts, consequences, implications, and hypotheses from various academic fields...

No abstract text is available yet for this article.

PURPOSE: This study aimed to identify challenges and potential improvements in Korea's medical education accreditation process according to the Accreditation Standards of the Korean Institute of Medical Education and Evaluation 2019 (ASK2019). Meta-evaluation was conducted to survey the experiences and perceptions of stakeholders, including self-assessment committee members, site visit committee members, administrative staff, and medical professors. METHODS: A cross-sectional study was conducted using surveys sent to 40 medical schools...

BACKGROUND: In the Iranian context, no 360-degree evaluation tool has been developed to assess the performance of prehospital medical emergency students in clinical settings. This article describes the development of a 360-degree evaluation tool and presents its first psychometric evaluation. METHODS: There were 2 steps in this study: step 1 involved developing the instrument (i.e., generating the items) and step 2 constituted the psychometric evaluation of the instrument...

BACKGROUND: ChatGPT is a large language model (LLM) based on artificial intelligence (AI) capable of responding in multiple languages and generating nuanced and highly complex responses. While ChatGPT holds promising applications in medical education, its limitations and potential risks cannot be ignored. METHODS: A scoping review was conducted for English articles discussing ChatGPT in the context of medical education published after 2022. A literature search was performed using PubMed/MEDLINE, Embase, and Web of Science databases, and information was extracted from the relevant studies that were ultimately included...

PURPOSE: The objective of this study was to assess the performance of ChatGPT (GPT-4) on all items, including those with diagrams, in the Japanese National License Examination for Pharmacists (JNLEP) and compare it with the previous GPT-3.5 model's performance. METHODS: The 107th JNLEP, conducted in 2022, with 344 items input into the GPT-4 model, was targeted for this study. Separately, 284 items, excluding those with diagrams, were entered into the GPT-3.5 model...

PURPOSE: We examined United States medical students' self-reported feedback encounters during clerkship training to better understand in situ feedback practices. Specifically, we asked: Who do students receive feedback from, about what, when, where, and how do they use it? We explored whether curricular expectations for preceptors' written commentary aligned with feedback as it occurs naturalistically in the workplace. METHODS: This study occurred from July 2021 to February 2022 at Southern Illinois University School of Medicine...

PURPOSE: Despite educational mandates to assess resident teaching competence, limited instruments with validity evidence exist for this purpose. Existing instruments do not allow faculty to assess resident-led teaching in a large group format or whether teaching was interactive. This study gathers validity evidence on the use of the Resident-led Large Group Teaching Assessment Instrument (Relate), an instrument used by faculty to assess resident teaching competency. Relate comprises 23 behaviors divided into six elements: learning environment, goals and objectives, content of talk, promotion of understanding and retention, session management, and closure...

No abstract text is available yet for this article.

PURPOSE: This study aimed to explore the perceptions held by practicing dietitians of the importance of their tasks performed in current work environments, the frequency at which those tasks are performed, and predictions about the importance of those tasks in future work environments. METHODS: This was a cross-sectional survey study. An online survey was administered to 350 practicing dietitians. They were asked to assess the importance, performance frequency, and predicted changes in the importance of 27 tasks using a 5-point scale...

No abstract text is available yet for this article.

PURPOSE: This study aimed to assess 6 generative artificial intelligences (AIs)' performance on the learning objectives of medical arthropodology in parasitology class in Korea. We examined AIs' performance by querying in Korean and English to determine their information amount, accuracy, and relevance in both language prompts. METHODS: From December 15 to 17, 2023, 6 generative AIs, including Bard, Bing, Claude, Clova X, GPT-4, and Wrtn, were tested on 7 medical arthropodology learning objectives in English and Korean...

It aims to explore ChatGPT's (GPT-3.5 version) functionalities, including reinforcement learning, diverse applications, and limitations. ChatGPT is an AI chatbot powered by OpenAI's Generative Pre-trained Transformer (GPT) model. The chatbot's applications span education, programming, content generation, and more, demonstrating its versatility. ChatGPT can enhance education by creating assignments and offering personalized feedback, as shown by its notable performance in medical exams and the USMLE. However, concerns include plagiarism, reliability, and educational disparities...

PURPOSE: Coronavirus disease 2019 (COVID-19) has heavily impacted medical clinical education in Taiwan. Medical curricula have been altered to minimize exposure and limit transmission. This study investigated the effect of COVID-19 on Taiwanese medical students' clinical performance using online standardized evaluation systems and explored the factors influencing medical education during the pandemic. METHODS: Medical students were scored from 0 to 100 based on their clinical performance from 1/1/2018 to 6/31/2021...

PURPOSE: This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students' perceptions of ChatGPT as a feedback tool in the classroom. METHODS: The study included 99 2nd-year pre-medical students who participated in a "Leadership and Communication" course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions...

PURPOSE: The purpose of this project was to implement a process for learner-driven, formative, prospective, ad-hoc, entrustment assessment in Doctor of Physical Therapy clinical education. Our goals were to develop an innovative entrustment assessment tool, and then explore whether the tool detected (1) differences between learners at different stages of development and (2) differences within learners across the course of a clinical education experience. We also investigated whether there was a relationship between the number of assessments and change in performance...

PURPOSE: This study aimed to evaluate the impact of a transcultural nursing course on enhancing the cultural competency of graduate nursing students in Korea. We hypothesized that participants' cultural competency would significantly improve in areas such as communication, biocultural ecology and family, dietary habits, death rituals, spirituality, equity, and empowerment and intermediation after completing the course. Furthermore, we assessed the participants' overall satisfaction with the course...

PURPOSE: The present study was conducted to determine the effect of motion-graphic video-based training on the performance of operating room nurse students in cataract surgery using phacoemulsification at Kermanshah University of Medical Sciences in Iran. METHODS: This was a randomized controlled study conducted among 36 students training to become operating room nurses. The control group only received routine training, and the intervention group received motion-graphic video-based training on the scrub nurse's performance in cataract surgery in addition to the educator's training...

PURPOSE: The objective of this study was to assess the feasibility of incorporating virtual reality/augmented reality (VR/AR) programs into practical tests administered as part of the Korean Radiological Technologists Licensing Examination (KRTLE). This evaluation is grounded in a comprehensive survey that targeted enrolled students in departments of radiology across the nation. METHODS: In total, 682 students from radiology departments across the nation were participants in the survey...

ChatGPT (GPT-3.5) has entered higher education and there is a need to determine how to use it effectively. This descriptive study compared the ability of GPT-3.5 and teachers to answer questions from dental students and construct detailed intended learning outcomes. When analyzed according to a Likert scale, we found that GPT-3.5 answered the questions from dental students in a similar or even more elaborate way compared to the answers that had previously been provided by a teacher. GPT-3.5 was also asked to construct detailed intended learning outcomes for a course in microbial pathogenesis, and when these were analyzed according to a Likert scale they were, to a large degree, found irrelevant...