Read by QxMD icon Read

Journal of Applied Measurement

Patrick U Osadebe
The study was carried out to assess the difficulty index of each item of an Economics Achievement test with the Rasch model. The infit and outfit as well as the reliability of the test were determined. Three research questions were drawn to guide the study. A sample of 200 was randomly selected using simple random sampling of balloting and proportionate stratified random sampling. The instrument of the study was an Economics Achievement Test with 100 items. The test has face and content validities. It has a reliability coefficient of 0...
2018: Journal of Applied Measurement
Beyza Aksu Dunya, Clark McKown, Everett V Smith
Social perspective-taking (SPT), which involves the ability infer others' intentions, is a consequential social cognitive process. The purpose of this study is to evaluate the psychometric properties of a web-based social perspective-taking (SELweb SPT) assessment designed for children in kindergarten through third grade. Data were collected from two separate samples of children. The first sample included 3224 children and the second sample included 4419 children. Data were calibrated using Rasch dichotomous model (Rasch, 1960)...
2018: Journal of Applied Measurement
Courtney Donovan
Teachers are expected to use data and assessments to drive their instruction. This is accomplished at a classroom level via the assessment process. The teachers Knowledge and Use of Data and Assessment (tKUDA) measure was created to capture teachers' knowledge and use of this assessment process. This paper explores the measure's utility using Rasch analysis. Evidence of reliability and validity was seen for both knowledge and use factors. Scale was used as expected and item analyses demonstrates good spread with a few items identified for future revision...
2018: Journal of Applied Measurement
Georgios D Sideridis, Cengiz Zopluoglu
The purpose of the present study was to evaluate various analytical means to detect academic cheating in an experimental setting. The omega index was compared and contrasted given a gold criterion of academic cheating which entailed a discrepant score between two administrations using an experimental study with real test takers. Participants were 164 elementary school students who were administered a mathematics exam followed by an equivalent mock exam under conditions of strict and relaxed, invigilation, respectively...
2018: Journal of Applied Measurement
Bo Hu
In linked-chain equating, equating errors may accumulate and cause scale drift. This simulation study extends the investigation on scale drift in linked-chain equating to mixed-format test. Specifically, the impact of equating method and the characteristics of anchor test and equating chain on equating errors and scale drift in IRT true score equating is examined. To evaluate equating results, a new method is used to derive true linking coefficients. The results indicate that the characteristic curve methods produce more accurate and reliable equating results than the moment methods...
2018: Journal of Applied Measurement
W Holmes Finch, Maria Hernandez Finch, Brian F French, David E McIntosh, Lauren Moss
An important aspect of the educational and psychological evaluation of individuals is the selection of scales with appropriate evidence of reliability and validity for inferences and uses of the scores for the population of interest. One key aspect of validity is the degree to which a scale fairly assesses the construct(s) of interest for members of different subgroups within the population. Typically, this issue is addressed statistically through assessment of differential item functioning (DIF) of individual items, or differential test functioning (DTF) of sets of items within the same measure...
2018: Journal of Applied Measurement
Carolina Saskia Fellinghauer, Birgit Prodinger, Alan Tennant
Imputation becomes common practice through availability of easy-to-use algorithms and software. This study aims to determine if different imputation strategies are robust to the extent and type of missingness, local item dependencies (LID), differential item functioning (DIF), and misfit when doing a Rasch analysis. Four samples were simulated and represented a sample with good metric properties, a sample with LID, a sample with DIF, and a sample with LID and DIF. Missing values were generated with increasing proportion and were either missing at random or completely at random...
2018: Journal of Applied Measurement
Marcos Cupani, Tatiana Castro Zamparella, Gisella Piumatti, Grupo Vinculado
The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants' test burden. This study aims to develop a bank of items to measure the level of Knowledge on Biology using the Rasch model. The sample consisted of 1219 participants that studied in different faculties of the National University of Cordoba (mean age = 21.85 years, SD = 4.66; 66.9% are women). The items were organized in different forms and into separate subtests, with some common items across subtests...
2017: Journal of Applied Measurement
Oliver Prosperi
Confidence marking is increasingly used in multiple choice testing situations, but when the Rasch measurement model is applied to the data, only the binary data is used, discarding the information given by the confidence marking. This study shows how Wilson's ordered partition model (OPM), a member of the Rasch family of models, can be used to model the confidence information. The result is a model which is in strict relation to the binary Rasch model, since the Rasch ICC's are "split" into a set of curves each representing a confidence level...
2017: Journal of Applied Measurement
Dan Cloney, Cuc Nguyen, Raymond J Adams, Collette Tayler, Gordon Cleveland, Karen Thorpe
The Classroom Assessment Scoring System (CLASS) is an observational instrument assessing the nature of everyday interactions in educational settings. The instrument has strong theoretical groundings; however, prior empirical validation of the CLASS has exposed some psychometric weaknesses. Further the instrument has not been the subject of psychometric analysis at the indicator level. Using a large dataset including observations of 993 Australian classrooms, confirmatory factor analysis is used to replicate findings from the few existing validation studies...
2017: Journal of Applied Measurement
Robert Schwartz, Elizabeth Ayers, Mark Wilson
There are different ways to conceive and measure learning progressions. The approach used by the ADMSR project followed the "four building blocks" approach outlined by the Berkeley Evaluation and Assessment Research (BEAR) Center and the BEAR Assessment System. The final building block of this approach involves the application of a measurement model. This paper focuses on the application of unidimensional and multidimensional item response theory (IRT) measurement models to the data from the ADMSR project...
2017: Journal of Applied Measurement
Lin Ma, Kelly E Green
This study explored optimization of item-attribute matrices with the linear logistic test model (Fischer, 1973), with optimal models explaining more variance in item difficulty due to identified item attributes. Data were 8th-grade mathematics test item responses of two TIMSS 2007 booklets. The study investigated three categories of attributes (content, cognitive process, and comprehensive cognitive process) at two grain levels (larger, smaller) and also compared results with random attribute matrices. The proposed attributes accounted for most of the variance in item difficulty for two assessment booklets (81% and 65%)...
2017: Journal of Applied Measurement
Milja Curcin, Ezekiel Sweiry
In scoring short constructed-response items it may be possible to apply different rubric types depending on the trait of achievement assessed. A rating scale and a partial credit Many-Facet Rasch Models (MFRM) were used to investigate whether levels-based (holistic) and hybrid (analytic) scoring rubrics functioned interchangeably when scoring short-response English reading comprehension test items. Whereas most research in similar contexts has focused solely on rater reliability, the use of MFRM in this study enabled examination of both the reliability and rating scale functioning aspects of scoring rubrics in parallel...
2017: Journal of Applied Measurement
Ahmad Zamri Khairani, Nor Shafrin Ahmad, Mohd Zahuri Khairani
Adolescences is an important transitional phase in human development where they experience physiological as well as psychological changes. Nevertheless, these changes are often understood by teachers, parents, and even the adolescents themselves. Thus, conflicts exist and adolescents are affected from the conflict physically and emotionally. An important state of emotions that result from this conflict is anger. This article describes the development and validation of the 34-item Adolescent Anger Inventory (AAI) to measure types of anger among Malaysian adolescents...
2017: Journal of Applied Measurement
Snejana Slantcheva-Durst, Mingyang Liu
This article discusses the construction and validation of an instrument to gauge community college students' confidence to perform in the global marketplace. The instrument was designed to capture students' beliefs in their own abilities to successfully carry out job-related tasks in cross-cultural work environments that are globally-interconnected and constantly at flux. The instrument items emerged from a comprehensive review of literature, nationwide workforce skills initiatives, rounds of expert panel analyses, and focus groups...
2017: Journal of Applied Measurement
Rense Lange, Cynthia Martinez-Garrido, Alexandre Ventura
Students may experience considerable fear and stress in school settings, and based on Dweck's (2006) notion of "mindset" we hypothesized that fear introduces qualitative changes in students' self-concepts. Hypotheses were tested on 3847 third-grade students from nine Iberoamerican countries (Bolivia, Chile, Colombia, Cuba, Ecuador, Panama, Peru, Spain, and Venezuela), who completed Murillo's (2007) adaptation of Marsh' (1988) SDQ-I. Rasch scaling indicated that the information-content of High-Fear students' ratings was more localized across the latent dimension than was that of Low-Fear students, and their ratings also showed less cognitive variety...
2017: Journal of Applied Measurement
Randall E Schumacker, Cathy Ka Weng Hoi
Research has suggested that self-reported responses on surveys can be affected by a participant's tendency toward social desirability, which would prevent them from revealing their true feelings or behaviors. Researchers should provide evidence that their results have not been affected by socially desirable responses using the Marlowe-Crowne Social Desirability Scale (MC-SDS). Past research has used the 33-item original form and 13-item short form of the MC-SDS, although a few researchers have found questionable validation of the 13 item MC-SDS in several populations...
2017: Journal of Applied Measurement
John T Kulas, Jeffrey A Smith, Hui Xu
Lord (1980) presented a purely conceptual equation to approximate the nonlinear functional relationship between classical test theory (CTT; aka true score theory) and item response theory (IRT) item discrimination indices. The current project proposes a modification to his equation that makes it useful in practice. The suggested modification acknowledges the more common contemporary CTT discrimination index of a corrected item-total correlation and incorporates item difficulty. We simulated slightly over 768 trillion individual item responses to uncover a best-fitting empirical function relating the IRT and CTT discrimination indices...
2017: Journal of Applied Measurement
Kari J Hodge, Grant B Morgan
Residual-based fit statistics are commonly used as an indication of the extent to which the item response data fit the Rash model. Fit statistic estimates are influenced by sample size and rules-of thumb estimates may result in incorrect conclusions about the extent to which the model fits the data. Estimates obtained in this analysis were compared to 250 simulated data sets to examine the stability of the estimates. All INFIT estimates were within the rule-of-thumb range of 0.7 to 1.3. However, only 82% of the INFIT estimates fell within the 2...
2017: Journal of Applied Measurement
Ida Marais, Victoria K Moir, Christopher W Lee
The Young Schema Questionnaire (YSQ) was developed to measure Early Maladaptive Schemas (EMS), a construct central to Schema Therapy (ST). Traditionally YSQ items were placed in a grouped format for each schema but in recent versions of the questionnaire, items are presented in a random order. This study investigates the effect of item placement on the psychometric properties of the questionnaire. On different occasions, participants completed two versions of the YSQ short form, one with items grouped according to schemas and another where items were placed in a random order...
2017: Journal of Applied Measurement
Fetch more papers »
Fetching more papers... Fetching...
Read by QxMD. Sign in or create an account to discover new knowledge that matter to you.
Remove bar
Read by QxMD icon Read

Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"