Prepared for the Planning Committee for a Think Tank entitled “Toward a National Report Card for Nursing” held in Montreal on February 13, 2011.
Research Team
Diane Doran, RN, PhD, FCAHS
Barbara Mildon, RN, PhD, CHE
Sean Clarke, RN, PhD, FAAN
Executive Summary:
This knowledge synthesis has been compiled on behalf of the planning committee for a Think Tank entitled “Toward a National Report Card for Nursing.” The objectives of the Think Tank are to create a shared vision and critical path for a national report card on nursing, to generate support for the work, and to outline the steps to achieve the national report card. The report card for nursing is envisioned as a selected minimum set of data on input, process and output indicators that can be collected nationally (initially using pilot sites) and benchmarked. In the future, such report card data will be used to formulate relationships between the levels of indicators, and will consequently reveal the contribution of nursing care to nursing sensitive outcomes and influence policy direction for nursing.
This knowledge synthesis identifies what is known about outcomes/performance monitoring initiatives in nursing, including specific indicators and reporting systems and what is known about the development, implementation and utilization of nursing report cards. This information supports the Think Tank objectives by providing participants with current and relevant knowledge to enable and advance their dialogue and decision-making related to a national report card for nursing.
The utilization of data in order to identify nursing’s contribution to quality care and to conduct research into patient outcomes dates back to Florence Nightingale. However, it was not until the late 1970s that efforts to systematically collect data to assess outcomes gained widespread attention. At that time concerns about quality of care prompted the development of datasets such as the “Universal Minimum Health Data Set” and the “Uniform Hospital Discharge Data Set,” now known as the “DAD” (Discharge Abstract Database). These datasets facilitated consistency in data collection amongst health care organizations by prescribing the data elements to be gathered. The aggregated data then informed the assessment of quality of care in hospitals and provided information on patients discharged from hospitals. However, these datasets did not include specific information about nursing care delivered to patients in the hospital, thereby rendering nurses’ contribution to patient, organizational and system outcomes invisible. To address that information gap, initiatives were undertaken in Canada and around the world to develop nursing minimum data sets (NMDS). These initiatives included Canada’s development of the Health Information: Nursing Components (HI:NC) system.
Building on experience with the various NMDS, nursing outcome databases were created to house clinical outcomes found to be sensitive to nursing care. Nursing sensitive outcomes were first identified for patient safety outcomes such as mortality, adverse events and complications during hospitalization. However, over time indicators reflective of improved client outcomes were identified including patients’ engagement in health care, their functional status and social and mental well-being. Initiatives to develop nursing sensitive outcomes, indicators and databases include the Health Outcomes for Better Information and Care project in Ontario (HOBIC); Canada-HOBIC (involving Saskatchewan and Manitoba); the National Database of Nursing Quality Indicators (NDNQI); the Collaborative Alliance for Nursing Outcomes California (CALNOC); the Military Nursing Outcomes Database (MilNOD); and the Veterans Affairs Nursing Outcomes Database (VANOD). These initiatives generate evidence in the form of data by which to identify a relationship between nursing care and outcomes for patients, clients and residents. Report cards were developed as a mechanism to share the results. In 2001 a Knowledge Synthesis: Toward a National Report Card in Nursing 4 Prepared for the Planning Committee – Toward a National Report Card for Nursing team of experienced nurse researchers in Ontario developed a nursing report which was the first step in the development of a balanced scorecard for nursing services. It provided recommendations and supporting evidence for the inclusion of nursing data in each of the four quadrants of the balanced scorecard (system integration and change; clinical utilization and outcomes; patient satisfaction; and financial performance and condition). The indicators were selected based on outcomes of care and included those experienced by the patient, nurses, informal caregivers (e.g. family and friends) and hospital. As the availability of outcomes data has increased over time, it has been used to improve the quality of care and for research examining the relationship between nursing inputs and outcomes.
Canada has many advantages that other countries do not have because of our national data sets housed at the Canadian Institute of Health Information, including the DAD, the Management Information System (MIS) and the Resident Assessment Instrument (RAI) suite of instruments. A nursing minimum data set could be linked to data within those datasets which contain the types of information about patients and facilities that are essential for risk adjustment.
The majority of NMDS focus on a core set of patient safety outcomes, such as pressure ulcers, falls, and nosocomial infections. HOBIC and C-HOBIC have taken a broader perspective to include outcomes such as functional status, symptoms, and therapeutic self-care. Several NMDS have also included a work environment survey which enables an examination of the impact of work environment change on nurse and patient outcomes. Collectively, these data elements are generally categorized according to Donabedian’s well recognized “structure, process and outcome framework.” Accordingly, selection of nursing sensitive outcomes for a Canadian nursing report card should encompass data from each of the three categories and should include both quality and safety indicators. Selection of report card data needs to be guided by appropriate research methods. Additionally three primary questions to guide indicator selection have been identified: 1) is the indicator meaningful, 2) feasible, and 3) actionable?
As Think Tank participants identify the next steps in advancing NMDS work in Canada the findings of this knowledge synthesis support the recommendation that the following questions be considered: 1) What data elements would constitute the minimum data set? 2) How can the data be captured in valid and reliable ways? 3) How can such data be linked to other data sets that contain information about patient and hospital characteristics? 4) How can data on nursing interventions be collected? And finally, 5) How can these data be analyzed and repackaged, not only to enable quality improvement and support for patient care decisions organization-wide, but also for application at the unit level by unit/service managers, front line nurses and other care providers at the point of service? It is also recommended that data related to nursing work environment be collected as part of the core dataset.
This knowledge synthesis provides evidence of a solid foundation of knowledge and achievements in the field of nursing outcomes measurement and reporting. The existence of reliable and valid nursing sensitive indicators and outcomes has been identified for both safety and quality outcomes for patients. Moreover, the feasibility of collecting and reporting such data has been affirmed. Data gathered in a national nursing report card could inform dialogue and planning regarding current nursing issues in Canada. The Think Tank represents a welcome and strategic opportunity to advance efforts to realize a national nursing report card.
View PDF Report (English)
View PDF Report (French)