Do test takers differ in ability?

Gepubliceerd door Metior op

Psychometrics deals with individual differences. Can we test whether test takers differ in ability to begin with? The open-source software package dexter, that we developed with two friends at Cito, has a function called ๐ข๐ง๐๐ข๐ฏ๐ข๐๐ฎ๐š๐ฅ_๐๐ข๐Ÿ๐Ÿ๐ž๐ซ๐ž๐ง๐œ๐ž๐ฌ that allows you to do precisely this. If no differences in ability are found, observed differences in test scores are random. An IRT model will fit perfectly, yet we measure nothing.

Under the hood, the function works by estimating a single ability for all persons. Dexter’s documentation does not mention that this adds an important possibility to ๐ฌ๐ญ๐š๐ง๐๐š๐ซ๐ ๐ฌ๐ž๐ญ๐ญ๐ข๐ง๐  that is not available elsewhere. To wit, we can test whether judges have actually been able to generate passing scores for one, and only one, (border-line) candidate. If so, observed discrepancies between judges are as expected. Otherwise, the judges either agree too much, or too little.

Wish to know more? Contact us at info@metior.consulting

Categorieรซn: spotlight

0 reacties

Geef een antwoord

Het e-mailadres wordt niet gepubliceerd. Vereiste velden zijn gemarkeerd met *