Implementation Measures

Tools for measuring implementation can assist child welfare systems and other service providers with addressing various issues and improving their overall efforts with exploring and installing evidence-based practices. It is important to note that measurement of implementation in child welfare has limited, but growing, available research. A recent review found that most implementation measures do not have a strong evidence base supporting their effectiveness (Lewis, Fischer, Weiner, Stanick, Kim, & Martinez, 2015)*. Below is a list of select implementation measurement tools that may be useful for child welfare or other service organizations. For a more comprehensive list of implementation measurement tools, see the Information on Other Measures category listed below.

Readiness Measures

Many individual programs have readiness assesses to help determine whether an agency or provider is appropriate for or prepared to implement the program. Information on readiness measures for specific programs can be found on the CEBC Registry website in the Implementation Information section for each program under Pre-Implementation Materials.

General organizational readiness to change measures also exist and may be useful in determining whether an organization is ready to begin a new program or change effort. Examples include:

Dimensions of Organizational Readiness - Revised (DOOR-R)

Assesses perspectives on intra- and extra-organizational implementation readiness
Contact: Kimberly E. Hoagwood, email: Kimberly.Hoagwood@nyumc.org

Organizational Readiness for Implementing Change (ORIC)

Measures organizational readiness for change in healthcare settings
Contact: Christopher M Shea, email: chris_shea@unc.edu

Organizational Readiness to Change Assessment (ORCA)

Identify and monitor organizational strengths and weaknesses to support implementation of evidence-based practices
Contact: Christian D. Helfrich, email: christian.helfrich@va.gov

TCU Organizational Readiness for Change (TCU ORC)

Examines 4 domains: Motivational factors, program resources, staff attributes and organizational climate.
Contact: http://ibr.tcu.edu/forms/organizational-staff-assessments/

Leadership Measures

Agency leaders can have a large impact on an agency's ability to implement change. It is essential that leadership be on board with any proposed changes and serve as a champion for the change. An example measure is:

Implementation Leadership Scale (ILS)

Brief measure of unit level implementation leadership
Contact: Gregory A. Aarons, email: gaarons@ucsd.edu

Culture and Climate Measures

Organizational culture and climate have been identified as important factors in the successful implementation of an evidence-based practice. Example measures include:

Evidence-Based Practice Attitude Scale (EBPAS)

50-item, self-report measure of clinician attitudes toward EBPs
Contact: Gregory A. Aarons, email: gaarons@ucsd.edu

Implementation Climate Scale (ICS)

Captures a broad range of issues important for effective EBP implementation
Contact: Mark Ehrhart, email: mehrhart@mail.sdsu.edu

Organizational Culture Assessment Instrument (OCAI)

Assessing current and preferred organizational culture
Contact: http://www.ocai-online.com/

Organizational Social Context (OSC) Measure

Measures organizational-level culture, climate, and work attitudes
Contact: http://cbhr.utk.edu/osc/

Program Fit Measures

Program fit measures can assist agencies with informing their decision to adopt a new program. Examples of program fit measures include:

Acceptability of Intervention Measure (AIM)

A 5-item scale that measures the perception among implementation stakeholders that a given treatment, service, practice, or innovation is agreeable, palatable, or satisfactory.
Available for free through this link: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0635-3

Intervention Appropriateness Measure (IAM)

A 5-item scale that measures the perceived fit, relevance, or compatibility of the innovation or evidence-based practice for a given practice setting, provider, or consumer, and/or perceived fit of the innovation to address a particular issue or problem.
Available for free through this link: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0635-3

Feasibility of Intervention Measure (FIM)

A 5-item scale that measures the extent to which a new treatment, or an innovation, can be successfully used or carried out within a given agency or setting.
Available for free through this link: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0635-3

Information on Other Measures

Society for Implementation Research Collaboration (SIRC) Instrument Review Project

List of approximately 450 implementation science instruments and the degree of empirical validation for each
https://www.societyforimplementationresearchcollaboration.org/sirc-projects/sirc-instrument-project/