+ Site Statistics
+ Search Articles
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ PDF Full Text
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Translate
+ Recently Requested

Hand-scoring error rates in psychological testing

Hand-scoring error rates in psychological testing

Assessment 9(3): 292-300

Despite the comprehensive treatment of test validity in most technical manuals, test authors appear to routinely assume that clients and professionals will score their instruments without error. Recently Allard and Faust challenged this assumption by suggesting that error rates "may not be rare or benign" and demonstrated that tests with more complex scoring procedures were associated with a greater number of scoring errors. This study investigated error rates that resulted from hand scoring seven psychometric tests commonly employed in psychological practice. Significant and serious error rates were identified for both psychologist and client scorers across all tests investigated. Scoring complexity was found to predict the base rate of scorer errors. The findings suggest that greater development in and attention to test-scoring procedures is required to restrict the likelihood of scorer error.

(PDF emailed within 0-6 h: $19.90)

Accession: 046211165

Download citation: RISBibTeXText

PMID: 12216786

DOI: 10.1177/1073191102009003008

Related references

Psychologist hand-scoring error rates on the Rothwell Miller Interest Blank: A comparison of three job allocation systems. Australian Journal of Psychology 56(1): 25-32, 2004

FP-TDI SNP scoring by manual and statistical procedures: a study of error rates and types. Biotechniques 34(3): 610-6, 618-20, 622 Passim, 2003

Reliability Testing of the Balance Error Scoring System in Children Between the Ages of 5 and 14. Clinical Journal of Sport Medicine 27(1): 64-68, 2016

Reducing med pass error rates. Consultant pharmacists lend a hand. Contemporary Longterm Care 14(2): 60-62, 1991

On-field testing environment and balance error scoring system performance during preseason screening of healthy collegiate baseball players. Journal of Athletic Training 42(4): 446-451, 2008

Prediction of hand strength by hand injury severity scoring system in hand injured patients. Disability and Rehabilitation 34(5): 423-428, 2012

Testing type II error rates in biological anthropology. American Journal of Physical Anthropology 111(2): 283-289, 2000

Quality error rates in point-of-care testing. Clinical Chemistry 57(9): 1267-1271, 2011

Trivial Two-Stage Group Testing with High Error Rates. Journal of Combinatorial Optimization 7(4): 361-368, 2003

Recovery and reliable change rates for patients scoring severe on depression, anxiety or impaired functioning in a psychological therapies service: IAPT. Mental Health Review Journal 20(1): 28-35, 2015

Estimation and control of multiple testing error rates for microarray studies. Briefings in Bioinformatics 7(1): 25-36, 2006

Implications of ABO error rates in proficiency testing for solid organ transplantation. Transplantation 82(6): 733-736, 2006

The errors of error testing: potential liability issues for medication error testing of pharmaceutical trademarks under U.S. law. Food and Drug Law Journal 59(2): 325-337, 2004

Error, power, and cluster separation rates of pairwise multiple testing procedures. Psychological Methods 18(3): 352-367, 2014

Naive application of permutation testing leads to inflated type I error rates. Genetics 178(1): 609-610, 2008