Read by QxMD icon Read

interrater reliability

J H Lewey, T M Kivisalu, L Giromini
The Rorschach Inkblot Method (RIM) is a performance-based personality assessment instrument used in both clinical and research settings worldwide. This investigation examines response-level, interrater reliability of U.S. graduate students enrolled in the same doctoral program and divided into two unique participant groups: 20 of those with previous Comprehensive System (CS) training background who are now trained in Rorschach Performance Assessment System (R-PAS; initial coders N = 11, blind coders N = 9), and 19 of those trained solely with R-PAS (initial coders N = 10, blind coders N = 9)...
June 14, 2018: Journal of Personality Assessment
Allison Gates, Michelle Gates, Gonçalo Duarte, Maria Cary, Monika Becker, Barbara Prediger, Ben Vandermeer, Ricardo M Fernandes, Dawid Pieper, Lisa Hartling
BACKGROUND: Systematic reviews (SRs) of randomised controlled trials (RCTs) can provide the best evidence to inform decision-making, but their methodological and reporting quality varies. Tools exist to guide the critical appraisal of quality and risk of bias in SRs, but evaluations of their measurement properties are limited. We will investigate the interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health...
June 13, 2018: Systematic Reviews
Simone Rodda, Stephanie S Merkouris, Charles Abraham, David C Hodgins, Sean Cowlishaw, Nicki A Dowling
Background and aims To date, no systematic approach to identifying the content and characteristics of psychological interventions used to reduce gambling or problem gambling has been developed. This study aimed to develop a reliable classification system capable of identifying intervention characteristics that could, potentially, account for greater or lesser effectiveness. Methods Intervention descriptions were content analyzed to identify common and differentiating characteristics. A coder manual was developed and applied by three independent coders to identify the presence or absence of defined characteristics in 46 psychological and self-help gambling interventions...
June 13, 2018: Journal of Behavioral Addictions
Laura Jarding, Laurie A Hogden, Stephen E Messier, Valeriy Kozmenko, Edward Simanton, Kerri Bjornson, Charisse Ortman Brockmueller
BACKGROUND: Neonatal nurse practitioner (NNP) procedural competence is essential. Procedural simulation provides opportunity to practice high-risk, low-frequency procedures and helps improve skill retention. A formal procedural simulation experience was created in an attempt to provide sufficient experience for NNPs. While preparing for the simulation experience, the group recognized the lack of validated competency metrics for most neonatal intensive care unit (NICU) procedures. PURPOSE: The purpose of this study was to create and validate procedural checklists measuring competence of NNPs participating in simulated performance of 9 high-risk NICU procedures...
June 8, 2018: Advances in Neonatal Care: Official Journal of the National Association of Neonatal Nurses
Ru Ying Fong, Wee Sern Sim Glen, Ahmad Khairil Mohamed Jamil, Wilson Wai San Tam, Yanika Kowitlawakul
OBJECTIVES: To compare the reliability, validity and resource utilization of the Emergency Severity Index (ESI) and Patient Acuity Category Scale (PACS) triage scales. METHODS: A descriptive, correlational, and cross-sectional design was used. Twenty-seven triage nurses were recruited to test interrater reliability for 20 patient case scenarios. Subsequently, interrater reliability was tested on 300 actual patients. Construct validity was analyzed using patients' hospital dispositions and resources utilized...
June 7, 2018: International Emergency Nursing
G Dieplinger, N Mokhaberi, R Wahba, S Peltzer, D Buchner, H A Schlösser, V Ditt, A von Borstel, U Bauerfeind, U Lange, W Arns, C Kurschat, H A Stippel, F Vitinius
BACKGROUND: Pretransplant psychosocial evaluation of living-donor kidney transplantation (LDKT) candidates identifies recipients with potentially inferior posttransplant outcomes. Rating instruments, based on semi-standardized interviews, help to improve and standardize psychosocial evaluation. The goal of this study was to retrospectively investigate the correlation between the Transplant Evaluation Rating Scale (TERS) and transplant outcome in LDKT recipients. METHODS: TERS scores were retrospectively generated by 2 raters based on comprehensive interviews of 146 LDKT recipients conducted by mental health professionals (interrater reliability, 0...
June 2018: Transplantation Proceedings
Valerie Steiger-Ronay, Sibel Tektas, Thomas Attin, Adrian Lussi, Klaus Becker, Daniel B Wiedemeier, Barbara Beyeler, Thiago S Carvalho
The aim of this in vitro study was to investigate the impact of saliva on the abrasion of eroded enamel using two measuring methods. A total of 80 bovine enamel specimens from 20 bovine incisors were allocated to four experimental groups (n = 20 specimens per group). After baseline surface microhardness (SMH) measurements and profilometry all specimens were subjected to erosion (2 min, 1% citric acid, pH: 3.6, 37°C). SMH was determined again, and the depths of the Knoop indentations were calculated. Thereafter, specimens were incubated in human saliva (group 1 - no incubation/control, group 2 - 0...
June 7, 2018: Caries Research
Yael Goverover, John DeLuca
BACKGROUND: Multiple sclerosis (MS) can have dramatic effects on performance of everyday life activity. However, the ability to assess everyday functional activity remains elusive. The purpose of this study was to establish validity and reliability to a performance-based assessment of everyday life activities called actual reality (AR). AR involves utilization of the Internet to perform three actual everyday life activities: purchasing (a) an airline ticket, (b) cookies, and (c) pizza...
May 2018: Rehabilitation Psychology
Brunhild M Halm, Tina A Leone, Lindsey T Chaudoin, Kenneth W McKinley, Carrie Ruzal-Shapiro, Adrian A Franke, Daniel S Tsze
OBJECTIVES: The identification of hydrocephalus in infants by pediatric emergency medicine (PEM) physicians using cranial point-of-care ultrasound (POCUS) has not been evaluated. We aimed to conduct a pilot/proof-of-concept study to evaluate whether PEM physicians can identify hydrocephalus (anterior horn width >5 mm) in 15 infants (mean 69 ± 42 days old) from the neonatal intensive care unit using POCUS. Our exploratory aims were to determine the test characteristics of cranial POCUS performed by PEM physicians for diagnosing hydrocephalus and the interrater reliability between measurements made by the PEM physicians and the radiologist...
June 5, 2018: Pediatric Emergency Care
Toby B Cumming, Danielle Lowe, Thomas Linden, Julie Bernhardt
The Montreal Cognitive Assessment (MoCA) is a widely used cognitive screening tool in stroke. As scoring the visuospatial/executive MoCA items involves subjective judgement, reliability is important. Analyzing data on these items from A Very Early Rehabilitation Trial (AVERT), we compared the original scoring of assessors ( n = 102) to blind scoring by a single, independent rater. In a sample of scoresheets from 1,119 participants, we found variable interrater reliability. The match between original assessors and the independent rater was the following: trail-making 97% (κ = 0...
June 1, 2018: Assessment
Julia Heany, Jennifer Torres, Cynthia Zagar, Tiffany Kostelec
Introduction In order to achieve the positive outcomes with parents and children demonstrated by many home visiting models, home visiting services must be well implemented. The Michigan Home Visiting Initiative developed a tool and procedure for monitoring implementation quality across models referred to as Michigan's Home Visiting Quality Assurance System (MHVQAS). This study field tested the MHVQAS. This article focuses on one of the study's evaluation questions: Can the MHVQAS be applied across models? Methods Eight local implementing agencies (LIAs) from four home visiting models (Healthy Families America, Early Head Start-Home Based, Parents as Teachers, Maternal Infant Health Program) and five reviewers participated in the study by completing site visits, tracking their time and costs, and completing surveys about the process...
June 5, 2018: Maternal and Child Health Journal
T Huber, M Paschold, F Schneble, A Poplawski, F Huettl, F Watzka, H Lang, W Kneist
BACKGROUND: Tools are needed to assess laparoscopic camera navigation (LCN) in the operating room. Here, we aimed to develop an objective rating scale for LCN. STUDY DESIGN: We defined the following key aspects of LCN: operational field centering, correct angle of the horizon, correct instrument visualization, verbal commands from the operating surgeon, and manual corrections from the operating surgeon. We then developed a score based on intraoperative error evaluation from intraoperative recordings of 80 procedures...
June 4, 2018: Surgical Endoscopy
Andrea Veljkovic, Murray Penner, Kevin Wing, Kaniza Zahra Abbas, Peter Salat, Johnny Lau, John E Femino, Phinit Phisitkul, Annunziato Amendola, Alastair Younger
BACKGROUND: Adverse events require consistent recording to determine the effect of alternate treatments. This study was undertaken to evaluate the Vancouver Foot and Ankle WNS complication scale to capture complications (W: wound, N: nerve, S: systemic) to assist in outcome recording. METHODS: Interrater reliability was tested in 2 settings: (1) between 2 blinded clinicians in a live clinical setting and (2) between 8 orthopedic surgeons using case vignettes based on a retrospective analysis of 500 foot and ankle procedures performed at the Toronto Western Hospital, Department of Orthopaedics...
June 1, 2018: Foot & Ankle International
Margo Minnich, Amanda J Kirkpatrick, Joely T Goodman, Ali Whittaker, Helen Stanton Chapple, Anne M Schoening, Maya M Khanna
BACKGROUND: Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. METHOD: Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience...
June 1, 2018: Journal of Nursing Education
Van Thai Nguyen, Toai Nguyen, Triin Jagomägi
OBJECTIVES: The study aimed to compare nasolabial aesthetics of patients with unilateral cleft lip and palate (UCLP) treated in Vietnam and Estonia using three rating methods: five-point aesthetic index, a visual analogue scale (VAS), and reference scores method. METHODS: A total of 56 patients with repaired UCLP (23 from Vietnam and 33 from Estonia) were included in this cross-sectional study. Patients' facial and profile photographs were cropped to reveal the nasolabial region and coded...
May 18, 2018: Journal of Cranio-maxillo-facial Surgery
Cynthia C Gadbury-Amyot, Pamela R Overman
Studies of assessment have shown that three elements-multiple assessments, over time, with multiple evaluators-provide the best strategy for global assessment of student competence in a valid and reliable manner, while experts on competency-based education (CBE) have defined the use of portfolios for assessment as a best practice for CBE. The aim of this article is to describe the five-year experience of one U.S. dental school's implementation of portfolio assessment of student competence as a programmatic global assessment strategy and to share the lessons learned...
June 2018: Journal of Dental Education
Magdalena M Oledzka, Sandra L Kaplan, Jane K Sweeney, Colleen Coulter, Debbie L Evans-Rogers
PURPOSE: To establish inter- and intrarater reliability for determining severity grades of the congenital muscular torticollis severity classification system (CMT-SCS). METHODS: A prospective reliability study with 145 physical therapists recorded severity ratings on 24 randomly-ordered patient cases including age of infant, cervical range of motion, and presence or absence of sternocleidomastoid mass. To compute intrarater reliability, cases were randomly reordered and graded by 82 of the original raters...
May 25, 2018: Pediatric Physical Therapy
Sarah A Amin, Carolyn Panzarella, Megan Lehnerd, Sean B Cash, Christina D Economos, Jennifer M Sacheck
BACKGROUND: Recent efforts supporting children's dietary behaviors suggest the importance of food literacy (FL), which is a multidimensional concept that encompasses food-related knowledge, skills, and behaviors. To date, FL has been largely informed by adult and adolescent research. AIMS: To assess the FL experiences, perceived skills, and knowledge of school-age children to inform FL educational opportunities. METHOD: Six focus groups were conducted with children (age 9-12 years) from three Massachusetts elementary schools...
May 1, 2018: Health Education & Behavior: the Official Publication of the Society for Public Health Education
Jens Brøndum Frøkjær, Weronika Nyholm Jensen, Gitte Holt, Halgurd Khalid Omar, Søren Schou Olesen
PURPOSE: A reliable and immediate diagnosis of internal hernia is important for optimal and timely management of patients with a history of gastric bypass surgery. The aims of this study were to evaluate the interrater agreement and diagnostic performance characteristics of seven predefined CT findings of internal herniation in patients admitted on clinical suspicion of internal herniation after laparoscopic Roux-en-Y gastric bypass (LRYGB). METHODS: Abdominal CT scans of 117 patients performed on clinical suspicion of internal hernia after LRYGB surgery were evaluated by three radiologists (two experts and one resident) for the following: (1) Swirl sign, (2) strangulation of superior mesenteric vein (SMV), (3) engorged mesenteric vessels and edema, (4) engorged lymph nodes, (5) ascites, (6) mushroom sign, (7) hurricane eye sign, and finally the overall conclusion...
May 29, 2018: Abdominal Radiology
Gesine H Seeber, Christoph Thalhamer, Julia Hahne, Omer Matthijs
INTRODUCTION: Commonly used clinical tests for posterior cruciate ligament (PCL) rupture detection exhibit several limitations, thus requiring more precise clinical PCL tests. The lateral-anterior drawer (LAD) test has been proposed as a manually applied testing alternative but not yet been evaluated in vivo. METHODS AND ANALYSIS: Fifteen patients presenting with an MRI-confirmed acute or chronic unilateral PCL rupture and 15 subjects with no prior knee injury in their medical history will be included in this prospective single-blinded cross-sectional cohort study...
May 29, 2018: BMJ Open
Fetch more papers »
Fetching more papers... Fetching...
Read by QxMD. Sign in or create an account to discover new knowledge that matter to you.
Remove bar
Read by QxMD icon Read

Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"