Ophélie Perrot, Aurelie Schirmann, Adrien Vidart, Cyrille Guillot-Tantay, Vincent Izard, Thierry Lebret, Bernard Boillot, Benoit Mesnard, Cedric Lebacle, François-Xavier Madec
OBJECTIVE: AI-derived language models are booming, and their place in medicine is undefined. The aim of our study is to compare responses to andrology clinical cases, between chatbots and andrologists, to assess the reliability of these technologies. MATERIAL AND METHOD: We analyzed the responses of 32 experts, 18 residents and three chatbots (ChatGPT v3.5, v4 and Bard) to 25 andrology clinical cases. Responses were assessed on a Likert scale ranging from 0 to 2 for each question (0-false response or no response; 1-partially correct response, 2- correct response), on the basis of the latest national or, in the absence of such, international recommendations...
April 8, 2024: Fr J Urol