MBQIP Frequently Asked Questions
Frequently asked questions regarding the Medicare Beneficiary Quality Improvement Project (MBQIP) are grouped into the following three categories:
- Programmatic: Information about the background and implementation of MBQIP
- Reporting: Information about how to report MBQIP data
- Data: Information about accessing, interpreting, and utilizing MBQIP data
- How is MBQIP funded?
- What are the current MBQIP measures?
- Does every critical access hospital (CAH) have to report on these measures?
- How is MBQIP participation defined?
- Does MBQIP replace the Centers for Medicare and Medicaid Services (CMS) Hospital Quality Measures?
- How were the MBQIP measures selected?
- With a small caseload, does it make sense to have CAHs publicly report?
- Where can I find a glossary of MBQIP terms or a list of MBQIP acronyms?
- How do I convince the CAHs in my state to participate in MBQIP reporting and improvement activities?
- How is data submitted or reported?
- Are there resources available to assist hospitals in finding a Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey vendor?
- Can hospitals conduct HCAHPS surveys on their own?
- What is “Population and Sampling” and is it required for CAHs participating in MBQIP?
- How do hospitals submit their quarterly Emergency Department Transfer Communication (EDTC) data for MBQIP?
- How do state Flex Programs submit quarterly EDTC data to the Federal Office of Rural Health Policy (FORHP)?
- What should state Flex Programs submit for EDTC if not all CAHs report?
- How can a CAH be sure they are abstracting data correctly?
- Who will have access to the data? How are reports produced?
- What MBQIP reports are available (and when), and how do I access them?
- What if there are no MBQIP Hospital Data Reports for some of the hospitals?
- Will MBQIP data be shared publicly on Care Compare?
- My CAH says they are participating in HCAHPS, why does their data not show up in the MBQIP Patient Engagement HCAHPS reports?
- The MBQIP reports indicate my HCAHPS scores are adjusted – what does that mean?
- What should state Flex Programs do with the available MBQIP data?
- How can Flex Programs find out which hospitals did not submit data?
- Are all CAHs included in the state-level reports and the state and national averages?
- How are the benchmarks on the MBQIP reports calculated?
- How do I get an error corrected in the EDTC data reports for my state?
- How do I get hospital names updated on the MBQIP Hospital Data Reports?
- Because of the small volumes in some CAHs, one case can skew performance data significantly. How can hospitals address this issue?
How is MBQIP funded?
The Medicare Beneficiary Quality Improvement Project (MBQIP) is funded through Medicare Rural Hospital Flexibility (Flex) Program dollars within each state. MBQIP activities comprise the core Flex Program area of quality improvement. Given that Flex funds are limited, states need to prioritize the needs of CAHs and fund activities to target those specific needs.
Here is a list of the current MBQIP measures.
FORHP asks that every hospital that is able, participate in and report on the MBQIP core measures. CAHs wishing to participate in any Flex-funded activities must meet the MBQIP eligibility requirements. For more information about the specifics of MBQIP eligibility requirements, please see the Flex Eligibility Criteria for MBQIP Participation.
How is MBQIP participation defined?
To be eligible to benefit from Flex funds and participate in Flex-funded activities, CAHs must meet annual MBQIP eligibility requirements set out by the FORHP, or have completed the necessary MBQIP Waiver. FORHP adopted a phased approach when determining the minimum level of reporting requirements in MBQIP for participation in Flex-funded activities, with requirements increasing each year. For more information about the specifics of MBQIP participation requirements, please see the Flex Eligibility Criteria for MBQIP Participation.
Does MBQIP replace the CMS Hospital Quality Measures?
No. Except for the EDTC and antibiotic stewardship measures, MBQIP core measures are a subset of measures from the CMS Hospital Inpatient and Outpatient Quality Reporting Programs. Hospitals currently reporting additional CMS measures are encouraged to continue that process.
How were the MBQIP measures selected?
FORHP selected the current measures with the input of rural experts who have worked with or within CAHs, including CAH quality administrators, the Flex Monitoring Team (FMT), the Technical Assistance and Services Center (TASC), Rural Quality Improvement Technical Assistance (RQITA), state Flex Coordinators, and rural clinical experts. FORHP adds measures to MBQIP as needed, with a strong preference for standardized measures that are supported by a national reporting system and in alignment with other Federal quality reporting programs. The MBQIP core measures are intended to remain consistent, but updates and adjustments are made based on changes to national quality priorities and reporting systems. For more information about how measures are added and removed from MBQIP, see the MBQIP Fundamentals Guide for State Flex Programs.
Yes. Public reporting of quality data is increasingly being tied to reimbursement from a variety of payers. It is to the advantage of CAHs to participate in public reporting to demonstrate the quality of services they provide and ensure preparedness for future payer requirements.
Hospitals with low volumes should report all of their cases; for MBQIP, there is no minimum required number of cases. While available to hospitals at the individual level, MBQIP data is aggregated at the state and national level, providing FORHP the ability to show a more robust picture of the quality of care being provided in CAHs. The aggregation addresses the small caseload issues faced by individual CAHs, as the small numbers in each CAH add up to many patients receiving care in rural hospitals for each state and the nation as a whole.
How do I convince the CAHs in my state to participate in MBQIP reporting and improvement activities?
Although MBQIP has identified a common set of rural-relevant measures for reporting and improvement nationally, each state may have unique opportunities and challenges for engaging CAHs in reporting and improvement activities. Flex Programs are encouraged to work in partnership with other organizations such as state hospital associations, quality improvement network quality improvement organizations (QIN-QIOs), hospital quality innovation contractors (HQICs), and others to encourage CAH participation. This list of MBQIP Talking Points is intended to equip state Flex Program staff with summary statements to address concerns and encourage participation in quality reporting and improvement programs.
Measures are submitted via a variety of methods, including reporting to the CMS Hospital Quality Reporting (HQR) secure portal via HARP using CART (the CMS Abstraction and Reporting Tool) or a vendor; the National Healthcare Safety Network (NHSN); and to the state Flex Program for the EDTC measure. For more information on the currently required measures and where each is reported, see the MBQIP Quality Reporting Guide, or the Data Submission Deadlines Chart.
Are there resources available to assist hospitals in finding an HCAHPS survey vendor?
Yes. TASC maintains an HCAHPS Vendor Directory, which includes:
- Information regarding the benefits and challenges of implementing the HCAHPS survey process in CAHs.
- Self-completed profiles with information that may be useful for CAHs in selecting a certified vendor.
Can hospitals conduct HCAHPS surveys on their own?
What is “Population and Sampling” and is it required for CAHs participating in MBQIP?
Population and Sampling refers to the recording of the number of cases that meet the measure set population requirements and the actual number of records being submitted to HQR. This is done by entering the data directly in HQR via HARP. Entering a "zero" (0) when appropriate in population and sampling data is a mechanism that allows CAHs to report that they had no eligible cases for a measure set in a given quarter. CAHs are strongly encouraged to submit their population and sample size counts each quarter, but reporting of population and sampling data is not required for data to be submitted to CMS.
How do hospitals submit their quarterly EDTC data for MBQIP?
Hospitals submit their quarterly EDTC data to the state Flex Program per whatever instructions are provided at the state-level. For more information about how your state manages submission of EDTC, reach out to your state Flex coordinator. You can find contact information for your state in the State Flex Profiles.
FORHP provides a personalized template to each state Flex Program for capturing hospital-level EDTC data on a quarterly basis. State Flex Programs will submit one spreadsheet for their state that includes the data for each individual CAH. Submissions should be sent to MBQIP@hrsa.gov. CAHs with no memorandum of understanding (MOU) in place are not included on the state templates. See the MBQIP EDTC Reporting Instructions for Flex Programs for more information.
What should state Flex programs submit for EDTC if not all CAHs report?
State Flex programs should submit EDTC data for all CAHs that did report. State Flex programs should follow up with those CAHs that did not report to determine the reason and identify opportunities to support and engage them in the process.
How can a CAH be sure they are abstracting data correctly?
A way for CAHs to ensure they are abstracting the MBQIP Core measures correctly is to participate in Abstraction for Accuracy. Offered by RQITA, this is a customized abstraction review process and phone consultation that will provide hospitals with the opportunity to receive one on one education and assistance on how to abstract the MBQIP Core measures. This is an opportunity for the hospitals to validate their abstraction process by comparing notes with an RQITA abstraction professional. For more information or to sign up, visit the Abstraction for Accuracy resource page.
CAHs, state Flex Coordinators, FORHP, and relevant parties such as FMT, RQITA, and TASC have access to hospital-level data submitted through CMS Hospital Quality Reporting (HQR) secure portal via HARP, NHSN, and state Flex programs for all hospitals participating in MBQIP. MBQIP Hospital Data Reports are produced by the FMT and provided to FORHP.
What MBQIP reports are available (and when), and how do I access them?
MBQIP Hospital Data Reports are uploaded to a state-specific workspace on a National Institutes of Health (NIH) secure portal. Staff from the FMT are responsible for uploading these reports. Flex staff with authorized access to their state workspace should receive an email from SecureEmailNotice@nih.gov when any activity (such as a report being uploaded or downloaded) occurs within their workspace.
Three sets of MBQIP Hospital Data Reports are available on an approximately quarterly basis: Patient Safety/Inpatient and Outpatient, Care Transitions (EDTC) and Patient Engagement (HCAHPS). Two types of Patient Safety/Inpatient and Outpatient reports are available: a Core measures report and an Additional measures report. In addition to individual hospital-level PDF reports, Flex Programs are provided a state summary report, an Excel file containing performance benchmarks for each of the 45 states, and an Excel file containing the underlying data for that quarter’s reports and a non-submission list.
The Anticipated MBQIP Data Reports Release Timelines for State Flex Programs provides estimates of when data report will be released based on historical timelines. The dates provided are subject to change and do not account for the time required for state Flex programs to distribute data to hospitals.
What if there are no MBQIP Hospital Data Reports for some of the hospitals?
If a CAH has not signed an MOU that is on record with FORHP, no MBQIP Hospital Data Reports will be produced, even if that CAH regularly submits quality data to the CMS Hospital Quality Reporting (HQR) secure portal via HARP QualityNet. State Flex Coordinators should contact their FORHP project officer to confirm whether or not they have an MOU on record for any CAH believed to be signed up for MBQIP but for which a report was not received.
Will MBQIP data be shared publicly on Care Compare?
For inpatient quality data to be shared publicly on Care Compare, hospitals must complete the Inpatient Quality Reporting Program Notice of Participation (NOP) and must not opt-out of publicly reporting inpatient quality data. If a CAH has completed the NOP and has not opted to suppress their quality data, then inpatient data submitted to NHSN and/or the CMS Hospital Quality Reporting (HQR) secure portal via HARP is eligible to be posted to Care Compare as long as the necessary volume thresholds are met.
In the Fiscal Year (FY) 2019 Outpatient Prospective Payment System (OPPS) Final Rule, CMS removed the NOP requirement for the Outpatient Quality Reporting Program. All outpatient data submitted to the CMS Hospital Quality Reporting (HQR) secure portal via HARP is now posted to Care Compare as long as the necessary volume thresholds are met.
Please note, as of FY 2016, hospitals participating in the Small Rural Hospital Improvement Grant Program (SHIP) are required both to conduct HCAHPS and to opt to publicly report HCAHPS data by completing the Inpatient Quality Reporting Program NOP. By doing so, all inpatient data reported to the CMS Hospital Quality Reporting (HQR) secure portal via HARP is eligible for publishing on Care Compare as long as the necessary volume thresholds are met as determined by CMS.
There are several possible reasons:
- HCAHPS data in the MBQIP Hospital Data Reports reflect the most recent four quarters. Thus, CAHs must have at least four consecutive quarters of HCAHPS data reported before they are included in the MBQIP Hospital Data Reports. (An exception to this: CMS did not make quarter 1 and quarter 2 2020 data available due to the public health emergency. Data for quarter 3 and quarter 4 2020 were made available and it appears that given the circumstances hospitals only needed those two consecutive quarters of HCAHPS data to be included.)
- In the past it’s been found that some HCAHPS vendors were not submitting CAH HCAHPS data, and/or were using vendor identified volume thresholds for submission (and CAHs may not always meet that threshold). CAHs should check with their HCAHPS vendor to ensure the vendor is submitting HCAHPS data to the CMS Hospital Quality Reporting (HQR) secure portal via HARP on their behalf (and if not, request that they do so).
- If the CAH recently converted, or had an ownership change that resulted in a change to their CMS Certification Number (CCN), they must have at least four consecutive quarters of HCAHPS data under their new CCN before the data will appear in the reports.
Back to Top ^
HCAHPS survey results are adjusted for patient-mix and mode of data collection to help ensure that differences in HCAHPS results reflect differences in hospital quality. Only the adjusted results are publicly reported and are considered the official results. Several questions on the survey, as well as items drawn from hospital administrative data, are used for the patient-mix adjustment. Examples of factors used for adjustment include the mode of survey implementation (mail, phone, mixed, interactive voice response) and patient-mix such as age, education, self-rated health, language, and under which service line they received care (surgery, maternity, medical). Neither patient race nor ethnicity is used to adjust HCAHPS results. The adjustment model also addresses the effects of non-response bias. More information about how the adjustments are made can be found under “Mode and Patient-Mix Adjustment” at HCAHPS Online.
What should state Flex Programs do with the available MBQIP data?
State Flex Programs should use the data to determine appropriate quality improvement activities to support CAHs through Flex funding. Individual hospitals can use the MBQIP Hospital Data Reports as an opportunity to review CAH comparison data at a state and national level.
State Flex Programs and CAHs should review the MBQIP Hospital Data Reports each quarter as one mechanism to identify opportunities to improve patient care. Data can be used for tracking CAH MBQIP participation, benchmarking, and identifying opportunities for quality improvement activities at the individual hospital and state level. State Flex Programs are also encouraged to work with CAHs to coordinate local sharing of quality data in more real-time than is possible relying on the MBQIP Hospital Data Reports.
When reviewing MBQIP Hospital Data Reports, CAHs could plot their data in a graph over time to look at trends and carefully review any quarter that is an outlier (drilling down to the patient level). The Quality Improvement Implementation Guide and Toolkit for CAHs includes an Internal Quality Monitoring Tool and related video tutorial that provides a template for CAHs to use specific to the required MBQIP measures.
With each quarter of MBQIP Hospital Data Reports, state Flex Programs receive a non-submission list that summarizes which CAHs did not submit a particular measure in the given quarter.
FORHP recommends state Flex Programs follow up with any CAHs that did not successfully submit data each quarter and ask them what challenges or barriers they may be facing that prevented them from submitting data. This will be important information to identify the needs of CAHs and provide appropriate technical assistance to increase reporting in future quarters.
How are the benchmarks on the MBQIP reports calculated?
90th percentile benchmarks are provided for measures on the MBQIP Patient Safety/Inpatient and Outpatient Care, and the Care Transitions (EDTC) reports. The benchmarks indicate the results on individual measures for the top 10% of CAHs reporting at a state and national level.
Top-performing CAH-specific benchmarks are not currently available as part of the MBQIP Patient Engagement (HCAHPS) reports. Benchmarking data for all hospitals participating in HCAHPS can be found in the HCAHPS percentile tables that are updated quarterly on the HCAHPS Online website. CAHs may also have benchmarking data available through their HCAHPS vendor.
How do I get an error corrected in the EDTC data reports for my state?
Flex Coordinators and CAHs are encouraged to review quarterly EDTC reports as soon as possible. If there are any errors in the reports, Flex staff should update the EDTC State Reporting Excel Spreadsheet and email the updated EDTC spreadsheet to MBQIP@hrsa.gov before the next quarter’s submission deadline. Corrected data will be updated in next quarter’s EDTC data reports.
- Example: After receiving quarter 1, 2016 (1Q16) EDTC data reports, a hospital notices that there is an error in the data. The Flex Coordinator corrects the data in the 1Q16 state reporting Excel spreadsheet and emails MBQIP@hrsa.gov by the EDTC submission deadline for 2Q16. The hospital’s correct data will be reflected in 2Q16 EDTC reports. This process only applies to data that is incorrect, not for data that was submitted late to Flex Programs or FORHP
- Data errors can only be corrected if the quarter of data is within the four most recent quarters of EDTC data reports. For example, if next quarter’s EDTC reports reflect data from 1Q16-4Q16, data previous to 1Q16 cannot be corrected
How do I get hospital names updated on the MBQIP Hospital Data Reports?
MBQIP is an initiative to encourage all CAHs to report their data, regardless of how many patients they have, and FORHP recognizes the issues variation when reporting small volumes. While it is true that a percentage at the individual hospital level is not significant with such low volumes, it is important to remember that each number is a patient. Whether one out of four patients does not receive the recommended care, or one out of 400, hospitals should be using the data to determine which processes should be improved to ensure that every patient receives the highest quality care.
State Flex Programs are encouraged to not lose sight of the bigger picture by focusing too narrowly on one measure for one quarter in one CAH. Instead, begin to look at trends and the aggregate data for the state. The small numbers in each CAH start adding up to many patients for each state and the nation as a whole!