+ Site Statistics
References:
54,258,434
Abstracts:
29,560,870
PMIDs:
28,072,757
+ Search Articles
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ PDF Full Text
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Translate
+ Recently Requested

Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: a systematic review



Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: a systematic review



Implementation Science 11(1): 148



Recent reviews have synthesised the psychometric properties of measures developed to examine implementation science constructs in healthcare and mental health settings. However, no reviews have focussed primarily on the properties of measures developed to assess innovations in public health and community settings. This review identified quantitative measures developed in public health and community settings, examined their psychometric properties, and described how the domains of each measure align with the five domains and 37 constructs of the Consolidated Framework for Implementation Research (CFIR). MEDLINE, PsycINFO, EMBASE, and CINAHL were searched to identify publications describing the development of measures to assess implementation science constructs in public health and community settings. The psychometric properties of each measure were assessed against recommended criteria for validity (face/content, construct, criterion), reliability (internal consistency, test-retest), responsiveness, acceptability, feasibility, and revalidation and cross-cultural adaptation. Relevant domains were mapped against implementation constructs defined by the CFIR. Fifty-one measures met the inclusion criteria. The majority of these were developed in schools, universities, or colleges and other workplaces or organisations. Overall, most measures did not adequately assess or report psychometric properties. Forty-six percent of measures using exploratory factor analysis reported >50 % of variance was explained by the final model; none of the measures assessed using confirmatory factor analysis reported root mean square error of approximation (<0.06) or comparative fit index (>0.95). Fifty percent of measures reported Cronbach's alpha of <0.70 for at least one domain; 6 % adequately assessed test-retest reliability; 16 % of measures adequately assessed criterion validity (i.e. known-groups); 2 % adequately assessed convergent validity (r > 0.40). Twenty-five percent of measures reported revalidation or cross-cultural validation. The CFIR constructs most frequently assessed by the included measures were relative advantage, available resources, knowledge and beliefs, complexity, implementation climate, and other personal resources (assessed by more than ten measures). Five CFIR constructs were not addressed by any measure. This review highlights gaps in the range of implementation constructs that are assessed by existing measures developed for use in public health and community settings. Moreover, measures with robust psychometric properties are lacking. Without rigorous tools, the factors associated with the successful implementation of innovations in these settings will remain unknown.

(PDF emailed within 0-6 h: $19.90)

Accession: 058659329

Download citation: RISBibTeXText

PMID: 27821146

DOI: 10.1186/s13012-016-0512-5


Related references

Factors influencing national implementation of innovations within community pharmacy: a systematic review applying the Consolidated Framework for Implementation Research. Implementation Science 14(1): 21, 2019

Factors shaping the implementation of the SAFE strategy for trachoma using the Consolidated Framework for Implementation Research: a systematic review. Global Health Action 12(1): 1570646, 2019

Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research. Implementation Science 13(1): 52, 2018

Implementation of internet-delivered cognitive behavior therapy within community mental health clinics: a process evaluation using the consolidated framework for implementation research. Bmc Psychiatry 17(1): 331, 2018

Application of the Consolidated Framework for Implementation Research to assess factors that may influence implementation of tobacco use treatment guidelines in the Viet Nam public health care delivery system. Implementation Science 12(1): 27, 2018

Validity and reliability of measures to assess constructs from the inner setting domain of the consolidated framework for implementation research in a pediatric clinic network implementing HPV programs. Bmc Health Services Research 19(1): 205, 2019

A systematic review of the use of the Consolidated Framework for Implementation Research. Implementation Science 11: 72, 2017

Using the Consolidated Framework for Implementation Research to Identify Barriers and Facilitators for the Implementation of an Internet-Based Patient-Provider Communication Service in Five Settings: A Qualitative Study. Journal of Medical Internet Research 17(11): E262, 2016

Combined use of the Consolidated Framework for Implementation Research (CFIR) and the Theoretical Domains Framework (TDF): a systematic review. Implementation Science 12(1): 2, 2017

Measuring Constructs of the Consolidated Framework for Implementation Research in the Context of Increasing Colorectal Cancer Screening in Federally Qualified Health Center. Health Services Research 53(6): 4178-4203, 2018

HealthPathways implementation in a New Zealand health region: a qualitative study using the Consolidated Framework for Implementation Research. Bmj Open 8(12): E025094-E025094, 2019

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science 4: 50, 2009

Third Places for Health Promotion with Older Adults: Using the Consolidated Framework for Implementation Research to Enhance Program Implementation and Evaluation. Journal of Urban Health 93(5): 851-870, 2016

Applying the consolidated framework for implementation research to identify barriers affecting implementation of an online frailty tool into primary health care: a qualitative study. Bmc Health Services Research 18(1): 395, 2018

Application of the Consolidated Framework for Implementation Research to community pharmacy: A framework for implementation research on pharmacy services. Research in Social and Administrative Pharmacy 13(5): 905-913, 2017