+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals



Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals



Bmc Medical Education 11: 77



Health educators need rigorously developed instruments to evaluate cognitive skills relating to evidence based practice (EBP). Previous EBP evaluation instruments have focused on the acquisition and appraisal of the evidence and are largely based in the medical profession. The aim of this study was to develop and validate an EBP evaluation instrument to assess EBP cognitive skills for entry-level health professional disciplines. The Fresno test of competence in evidence based medicine was considered in the development of the 'Knowledge of Research Evidence Competencies' instrument (K-REC). The K-REC was reviewed for content validity. Two cohorts of entry-level students were recruited for the pilot study, those who had been exposed to EBP training (physiotherapy students, n = 24), and who had not been exposed to EBP training (human movement students, n = 76). The K-REC was administered to one cohort of students (n = 24) on two testing occasions to evaluate test-retest reliability. Two raters independently scored the first test occasion (n = 24) to evaluate the inter-rater reliability of the marking guidelines. Construct validity was assessed by comparison of the two groups, 'exposed' and 'non-exposed', and the percentage of students achieving a 'pass' score in each of these groups. Item difficulty was established. Among the 100 participants (24 EBP 'exposed', and 76 EBP 'non-exposed' students), there was a statistically significant (p < 0.0001) difference in the total K-REC scores. The test-retest and inter-rater reliability of the individual items and total scores ranged from moderate to excellent (measured by Cohen's Kappa and ICC, range: 0.62 to perfect agreement). The K-REC instrument is a valid and reliable evaluation instrument of cognitive skills of EBP in entry-level student health professionals. The instrument is quick to disseminate and easy to score, making it a suitable instrument for health educators to employ to evaluate students' knowledge of EBP or in the evaluation of entry-level EBP training.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 052547166

Download citation: RISBibTeXText

PMID: 21967728

DOI: 10.1186/1472-6920-11-77


Related references

Development and psychometric testing of the Team-Based Learning Student Assessment Instrument. Nurse Educator 37(4): 168-172, 2012

Student nurses' knowledge and skills of children's environmental health: Instrument development and psychometric analysis using item response theory. Nurse Education Today 69: 113-119, 2018

The development and psychometric testing of a theory-based instrument to evaluate nurses' perception of clinical reasoning competence. Journal of Advanced Nursing 72(3): 707-717, 2016

Evidence-based practice: perceptions, skills, and activities of pediatric health care professionals. Journal of Pediatric Nursing 26(2): 114-121, 2011

Development and Validation of an Instrument to Measure Knowledge of Evidence-Based Practice and Searching Skills. Medical Education Online 9(1): 4354, 2004

Measuring Mental Health Provider-Based Stigma: Development and Initial Psychometric Testing of a Self-Assessment Instrument. Community Mental Health Journal, 2017

Psychometric Testing of the Health Care Evidence-Based Practice Assessment Tool. Journal of Nursing Measurement 23(3): 485-498, 2016

Healthcare professionals' behavior, skills, knowledge and attitudes on evidence-based health practice: a protocol of cross-sectional study. BMJ Open 8(6): E018400, 2018

Practice write-ups: an assessment instrument that contributes to bridging the differences between theory and practice for student nurses through the development of core skills. Nurse Education Today 17(1): 53-57, 1997

Development and psychometric testing of the nursing student mentors' competence instrument (MCI): A cross-sectional study. Nurse Education Today 68: 93-99, 2018

Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire. Medical Teacher 32(9): E373-E380, 2011

The Mother's Autonomy in Decision Making (MADM) scale: Patient-led development and psychometric testing of a new instrument to evaluate experience of maternity care. Plos One 12(2): E0171804, 2017

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals. Revista Latino-Americana de Enfermagem 24: E2772, 2017

Development and pilot testing of a tool to assess evidence-based practice skills among French general practitioners. Bmc Medical Education 18(1): 254, 2018

Development of Depression Profile: a new psychometric instrument to selectively evaluate depressive symptoms based on the neurocircuitry theory. Neuropsychopharmacologia Hungarica 12(2): 337-345, 2010