Evaluation of Project Outcomes

To see the IBH Hospitals' Project Outcomes, visit the Project Outcome page. Read on to learn about the process to collect and assess outcomes. 

RHI utilizes a process called the Recommendation Adoption Progress (RAP) report to assess the outcomes of the hospital projects. The purpose of the RAP is to gather information on the progress of project implementation and ultimately project outcomes by interviewing hospital project teams at regular intervals during the project implementation. Equally important is the attempt to demonstrate ways the project has become embedded in the culture of the hospital. RAP interviews are held quarterly which assists to keep the teams focused and motivated.

The RAP discussion involves a 20-minute phone call with hospital project leaders. In addition to the status of the measurable outcomes recorded in hospitals' Data Sheets, the conversation focuses on “telling the rest of the story.” This is a somewhat structured, yet fluid dialogue concerning the team progress, successes, next steps and cultural impact.

The RAP Process

  • RAP interviews via phone calls were scheduled at regular intervals during the project
  • General topics to be discussed were sent prior to meeting so that CEO/team could prepare but actual conversation was fluid depending on information shared
  • RAP was conducted primarily with hospital project lead but other hospital leadership were encouraged to attend
  • RAP focused on the extent to which the hospital had implemented plans, what was going well, the measurable results in anticipated outcomes, impact on the hospital or community and next steps
  • Measurable outcomes were requested from the hospital prior to the RAP interview and were reviewed if needed during the RAP

Items Discussed in RAP Interview

  1. On a scale of 1 – 5, hospitals were asked to rate the extent to which the hospital had progressed on their individual work plan
    • One (1) = No progress had been made on the work plan
    • Two (2) = Implementation had begun
    • Three (3) = Implementation was well underway
    • Four (4) = Implementation was underway and the hospital was beginning to identify outcomes
    • Five (5) = The project was completed and sustained with measurable outcomes.
  2. What is going well concerning the implementation of the work plan?
  3. What are your hospital's expected next steps towards implementation of the work plan? 
  4. Aside from the measurable outcomes, what are some of the ways this project has impacted your hospital, its culture, and the community?
  5. Review any measurable outcomes if needed.

This project is supported by the Federal Office of Rural Health Policy (FORHP), Health Resources and Services Administration (HRSA), U.S. Department of Health and Human Services (HHS) under grant number H54RH00023. The information, conclusions and opinions expressed in this document are those of the authors and no endorsement by FORHP, HRSA or HHS is intended or should be inferred.