Authors

  1. Pate, Kimberly DNP, RN, ACCNS-AG, NE-BC, PCCN-K, FCNS
  2. Belin, Latasia DNP, APRN, AGCNS-BC, ONC, FCNS
  3. Layell, Jessica MSN, RN, CIC

Article Content

Nurse leaders face numerous challenges including emerging from the COVID-19 pandemic, rising demands for healthcare, recruitment, staffing, patient safety, ongoing practice changes, and ensuring quality outcomes. Additionally, healthcare reform has placed a heightened focus on clinical performance and outcomes to increase the value of healthcare in the US. This is driven by the Centers for Medicare and Medicaid Services' endorsement of value-based purchasing, bundled programs, and accountable care organizations.1 In achieving organizational goals, senior leaders must be role models because frontline staff determine the importance of specific quality measures based on where and how leaders dedicate their time. To foster a culture of continuous quality improvement (QI), nurse leaders must engage their frontline staff to develop, successfully implement, and sustain evidence-based guidelines in an inclusive, bottom-up culture.2

  
Figure. No caption a... - Click to enlarge in new windowFigure. No caption available.

Background

In 2010, Atul Gawande published The Checklist Manifesto, discussing how humans are fallible in terms of memory and attention. Successful use of complex and advanced technology requires too many simple tasks to remember, and key steps can be missed. Thus, a simple solution is to use a checklist to summarize key components.3 In healthcare, clinical audits are a systematic process to review patient care against defined criteria to identify gaps.4 Auditing and the associated feedback are vital to QI initiatives, because they reduce variation in practice and can lead to better patient outcomes.5

 

In reviewing the recent literature, numerous articles have demonstrated that auditing promotes positive change in a behavior, increases accountability, improves quality of care, and enhances patient safety.4-9 Researchers have used auditing to increase compliance with pain reassessments and documentation following the administration of pain medication, with some organizations observing up to 91% improvement.10 A longitudinal observation study demonstrated an increase in overall hand hygiene among nurses (17.8%) and physicians (65.8%) through direct observations and feedback over an 8-year period, resulting in decreased healthcare-associated infections.11 Researchers used auditing and feedback to improve compliance with antimicrobial stewardship guidelines from 55% to 71%; documentation of an indication for an antimicrobial agent increased from 75% to 98%.12

 

However, other sources have demonstrated that auditing and feedback has variable effects on patient care and QI, despite the dedication of significant resources including nurses' time.13,14 In a systematic review, researchers found the use of electronic audits produced highly variable results despite the more frequent and automatic feedback, ease of tracking measurable practice goals, and adherence to action plans in real time.6 Furthermore, a qualitative study asserted that the auditing process was perceived as fragmented; variable in effectiveness; and lacking in transparency with feedback that was untimely, incomplete, and not actionable.5 This all suggests that implementing audits and associated findings isn't a straightforward process.7

 

Using audits to support QI

The goal of this project was to evaluate the successes and challenges of auditing as an intervention to drive QI changes. The auditing tool, implementation processes, and outcomes of three QI initiatives to address central line-associated blood stream infections (CLABSI), falls and falls with injury, and hand hygiene were examined (see Table 1). Each initiative occurred at two adult inpatient, acute care facilities in the southeastern US: an 874-bed tertiary research and academic medical center and a 196-bed community hospital. Both facilities are Magnet(R) recognized and routinely partner to collaboratively address quality opportunities. Similar support resources are available in each facility through the clinical nurse specialists (CNSs), clinical nurse leaders (CNLs), master's prepared educators, and infection preventionists as well as available technology.

  
Table 1: Description... - Click to enlarge in new windowTable 1: Description of QI initiatives

CLABSI rounding team

To address rising CLABSI rates, a team of CNSs partnered with infection preventionists to develop a comprehensive, standardized auditing tool that addressed potentially problematic areas of opportunity: antimicrobial disk compliance, cleanliness of needleless connectors, presence of alcohol caps, compliance with labeling of tubing, presence of sluggish or clotted lines, completion of chlorhexidine bathing, and appropriate assessment of central line necessity. A team of master's-prepared nurses was recruited to ensure the audits were completed in a consistent manner with coaching and just-in-time education provided to direct care nurses. However, the frequency and number of audits performed varied according to auditor availability and the number of patients with central lines. Additional challenges with engagement were related to COVID-19 surges and associated staffing shortages.

 

Audits were completed in an electronic Microsoft Forms survey; however, the rounding team performed audits using a printed copy with results entered later. Performing audits in this manner allowed the auditor to review the electronic health record (EHR) components of the audit at a different time. In addition, the results of the completed audits flowed into a PowerBI dashboard, a business intelligence platform that transforms data from various sources into interactive reports for easy review by nurse leaders to identify trends. Trends were addressed with the support of master's-prepared educators via targeted, unit-based, education interventions with opportunities stressed. Facility leaders, including infectious disease providers, anecdotally noted positive changes in the appearance of central line dressings. However, once these changes were noted, leader focus shifted, and the rounding team was pulled to other projects, leading to inconsistent auditing. Accordingly, outcomes were inconsistent, with periods of reduced CLABSI rates correlating with an increase in the number of audits being performed. This initiative is currently being revised to address the opportunities identified and support sustainment.

 

Falls prevention

To address patient falls and falls with injury, the healthcare system selected a comprehensive, individualized falls management program. Successful implementation and sustainment were monitored through scoring audits to evaluate the accurate completion of a fall assessment tool as well as intervention audits to ensure that key strategies for fall prevention were in place. Each patient-care area had a nurse manager and a CNS who provided structure and support as well as identified high performers to assist with auditing. Although success was demonstrated on units with an engaged unit-based champion who provided real-time feedback to their peers, concerns did arise regarding the accuracy of audits on units with less experienced nurses completing the audits.

 

All units started with completing 10 scoring and intervention audits per week. The volume of audits was reevaluated and reduced based on positive performance, with each unit eventually moving to 10 audits per month. Audits were completed in a PowerBI platform outside of the healthcare system, which required frequent provision of directions on platform access and how to manipulate the database to ensure consistent completion. This also caused a lack of data transparency among all facility leaders because only select individuals were granted access. An additional challenge was that the healthcare system facilities were going live with a new EHR and the many associated process changes while this falls audit program was implemented. Because of conflicting priorities, some units couldn't start their audits as quickly as others. Both facilities were performing at the National Database of Nursing Quality Indicators(R) mean for falls; however, the quarterly rates for falls and falls with injury improved for the 6-month period following implementation. The collected data are now being used to support targeted interventions to improve overall compliance with the falls audit program.

 

Hand hygiene

The Leapfrog Group, a nonprofit organization, publicly reports hospitals' quality and safety data outcomes to healthcare consumers.15 Current Leapfrog requirements have challenged healthcare organizations to structure hand hygiene observations. Nurse managers on all shifts selected unit-based observers with the goal of collecting 100 hand hygiene observations per quarter and providing real-time feedback to their peers. Observers are mostly frontline staff without dedicated time allotted for audits, creating challenges in ensuring meaningful audit completion and feedback due to competing priorities such as patient care. Additionally, frontline staff reported that providing constructive feedback to colleagues isn't a popular concept, as staff feel a lack of support to do so, fear tension or retaliation, and don't see leaders role modeling the behavior.

 

To validate that the peer audits reflect true unit performance, infection preventionists perform additional observations using the mystery shopping method with trained individuals who round on units at unannounced times without teammate awareness. In one facility, these audits demonstrated a year-to-date compliance of 74%, whereas unit-based observers reported 89% compliance. In contrast, the second facility demonstrated an infection prevention compliance audit of 65% and a unit-based observer compliance of 83%. However, validation audits have been limited due to staffing shortages in the Infection Prevention department.

 

Audits were initially collected and stored in Verge, an external platform; however, the platform was changed to the Microsoft Forms for ease of completion due to reports of the system freezing when entering large amounts of data, delays in displaying new entries, and challenges correcting entries. Although the volume of observations has met the Leapfrog targets, overall compliance remains below the target goal of 90%, with ongoing support from nursing leaders to promote further improvements.

 

Recommendations for nurse leaders

From these experiences, the overall aims of the audit, specific objectives, and methodology must be clearly defined and measurable, and this is consistent with literature-based recommendations.4 It's imperative to have a consistent process and clear expectations. This includes identifying who performs the audits, the number of audits to be performed, and where data will be accumulated. Nurse leaders must consider the frequency of audits and time required to complete this work because it may interfere with staff assignments and workload as well as create delays in identifying strategies to address the opportunities noted.4 Compared with paper forms, entering audits into a digital form allowed for data to be exported into a PowerBI dashboard that was easy to share with direct care nurses and senior leaders. Further, the data could be easily filtered to identify unit-, service line-, and facility-level trends. When data are easily accessible through local databases and trusted as a true reflection of performance, healthcare facilities are more likely to encounter proactive, consistent use of feedback, which provides opportunities to stimulate QI initiatives.14

 

The value of the information collected is strongly dependent on the individual completing the audit. Experienced auditors are imperative because they understand the process being audited and can determine the root cause of identified issues and make recommendations for improvement.1 For example, the participation of facility leaders such as CNSs and CNLs ensures a high level of audit completion integrity as well as coaching and accountability when opportunities arise. In contrast, a unit-based champion can also be beneficial. Champions serve as role models dedicated to implementing and encouraging change, using the audit data as a tool to provide feedback to their teams.7 Leaders must select high-performing candidates because less experienced direct care nurses may feel pressured for time and simply check the boxes, which can lead to concern about audit data accuracy.

 

Further, the ability to provide feedback is a critical skill for an auditor. Less experienced nurses may not feel comfortable sharing constructive feedback to a more experienced peer. That said, audits may be more relevant if a peer is the driving force, as this fosters trust.7 Feedback must not only be timely, actionable, and provide the data required for behavior change, it must also be tailored to the needs of the team to improve performance.5 If feedback is perceived as negative or overly critical instead of constructive, the value may be lost. Direct care nurses must feel the audit journey is a collective process, with everyone having their own share of accountability, instead of feeling isolated.8

 

Regardless of experience level, training is needed to ensure auditors understand the audit tool and associated healthcare facility protocols.1,4 This ensures the process is standardized and results are consistent. Audit teams should demonstrate achievement of specific competencies to ensure audits are conducted in a professional manner.4 Each QI initiative shared in this article required either formal training of auditors via a learning module or informal training via a one-on-one discussion with a leader in the respective initiative. Because of the newness of the comprehensive falls program, even nurse leaders accustomed to performing audits required routine meetings and access to a vendor-associated sustainability coach to clarify key concepts and support the success of the audit team.

 

Timing is pivotal to the success of any QI initiative. It can be challenging to maintain consistent support when nurse auditors are being pulled in numerous directions, which occurred with the CLABSI rounding team during COVID-19 surges, staffing challenges, and implementation of a new EHR. Success requires the nurse auditor to have sufficient time to review the audit results, follow up with direct care nurses about positive and negative findings, ensure professional accountability, and engage senior leaders for support and buy-in.

 

Success has also been linked to the ability to integrate auditing into daily clinical activities.5 For example, one CNS completed CLABSI audits while simultaneously performing falls prevention audits. In contrast, additional options include nonlicensed teammates assisting with falls prevention audits as well as incorporating audits into purposeful hourly rounding and bedside report. More creative options include incorporating new technology. For example, some healthcare facilities have opted to implement electronic hand hygiene monitoring systems that eliminate the burden of staff collecting audits and increase the amount of data available.

 

An additional key element to consider is what happens with the information that's collected in audits. The individuals who collect the data must see the value that their work creates. Leaders must review the data and use them to drive the change at hand. Any feedback provided must be timely, specific, and actionable.5 Informal leaders including CNSs can coach for success, but direct leader support is necessary when accountability issues are encountered. Consistency is pivotal, with leaders always demonstrating follow-through. In addition, as opportunities are identified, action plans must be built by the leaders of QI initiatives to address opportunities that arise and include specific steps and key deliverables to improve patient outcomes.1

 

For example, when the CLABSI team identified an opportunity with timely discontinuation of central lines, the infection preventionists built an action plan including the implementation of a line stewardship program. CNSs were recruited as partners to routinely evaluate the need for a line, facilitate communication with the providers, and provide recommendations for prompt line removal.

 

An additional opportunity is determining a method for sustainability. As time passes, improvement plateaus, and staff may no longer see audits as a driver of change.7 Nurse leaders must determine how the outcomes achieved will be maintained once the auditing wanes or ceases. Although audits increase awareness around the topic of measure and address the contributing factors, it's imperative to monitor for auditing fatigue and how many audits are being completed over time. Leaders must also balance the competing forces inclusive of staffing and other initiatives that arise. Further, in larger facilities, there's the added conundrum of siloed and competing initiatives in the system. A combination of a strong senior leader, engaged direct care clinicians, and robust shared governance structure to empower direct care nurses are keys to addressing this concern.

 

Maintaining focus on success

Overall, each quality initiative demonstrated a measure of success despite noted variations in strengths and weaknesses. To ensure positive outcomes with clinical audits, it's imperative for nurse leaders to be actively involved in quality initiatives that use an auditing tool. Data are power, and nurse leaders can use this information for coaching and accountability to drive quality outcomes. However, it's critical to monitor the process to ensure that the common pitfalls identified in this article are avoided. Negative outcomes are perpetuated by the combination of a lack of leadership focus, not involving team members with high integrity and appropriate training, deficiencies in project structure, and absence of situational awareness of leaders for auditing fatigue and competing forces. In addition, nurse leaders are responsible for being role models who can help direct care nurses to see the value of the goal, the work being done to support this goal, and the progress made. Conflicting messages and pulling auditors in multiple directions with too many strategies and initiatives can sabotage a project.

 

A limitation of this article is that it only provides the perspective of two healthcare facilities. Future work may focus on using a more formal quantitative or qualitative methodology to validate local experiences against those of other healthcare facilities.

 

INSTRUCTIONS Auditing to support quality improvement: Recommendations for nurse leaders

TEST INSTRUCTIONS

 

* Read the article. The test for this nursing continuing professional development (NCPD) activity is to be taken online at http://www.NursingCenter.com/CE.

 

* You'll need to create an account (it's free!) and log in to access My Planner before taking online tests. Your planner will keep track of all your Lippincott Professional Development online NCPD activities for you.

 

* There's only one correct answer for each question. A passing score for this test is 7 correct answers. If you pass, you can print your certificate of earned contact hours and access the answer key. If you fail, you have the option of taking the test again at no additional cost.

 

* For questions, contact Lippincott Professional Development: 1-800-787-8985.

 

* Registration deadline is June 5, 2026.

 

PROVIDER ACCREDITATION

Lippincott Professional Development will award 2.0 contact hours for this nursing continuing professional development activity.

 

Lippincott Professional Development is accredited as a provider of nursing continuing professional development by the American Nurses Credentialing Center's Commission on Accreditation.

 

This activity is also provider approved by the California Board of Registered Nursing, Provider Number CEP 11749 for 2.0 contact hours. Lippincott Professional Development is also an approved provider of continuing nursing education by the District of Columbia, Georgia, Florida, New Mexico, South Carolina, and West Virginia, CE Broker #50-1223. Your certificate is valid in all states.

 

Payment: The registration fee for this test is $21.95.

 

REFERENCES

 

1. Haycock C, Schandl A. A new tool for quality: the internal audit. Nurs Adm Q. 2017;41(4):321-327. [Context Link]

 

2. Drew JR, Pandit M. Why healthcare leadership should embrace quality improvement. BMJ. 2020;368:m872. [Context Link]

 

3. Gawande A. The Checklist Manifesto: How to Get Things Right. New York, NY: Picador; 2011. [Context Link]

 

4. Glenngard AH, Anell A. The impact of audit and feedback to support change behaviour in healthcare organisations - a cross-sectional qualitative study of primary care centre managers. BMC Health Serv Res. 2021;21(1):663. [Context Link]

 

5. Sinuff T, Muscedere J, Rozmovits L, Dale CM, Scales DC. A qualitative study of the variable effects of audit and feedback in the ICU. BMJ Qual Saf. 2015;24(6):393-399. [Context Link]

 

6. Tuti T, Nzinga J, Njoroge M, et al A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implement Sci. 2017;12(1):61. [Context Link]

 

7. Hut-Mossel L, Ahaus K, Welker G, Gans R. Understanding how and why audits work in improving the quality of hospital care: a systematic realist review. PLoS One. 2021;16(3):e0248677. [Context Link]

 

8. Christina V, Baldwin K, Biron A, Emed J, Lepage K. Factors influencing the effectiveness of audit and feedback: nurses' perceptions. J Nurs Manag. 2016;24(8):1080-1087. [Context Link]

 

9. Ramukumba MM, El Amouri S. Nurses' perspectives of the nursing documentation audit process. Health SA. 2019;24:1121. [Context Link]

 

10. Ho J, Burger D. Improving medication safety practice at a community hospital: a focus on bar code medication administration scanning and pain reassessment. BMJ Open Qual. 2020;9(3):e000987. [Context Link]

 

11. Ojanpera H, Ohtonen P, Kanste O, Syrjala H. Impact of direct hand hygiene observations and feedback on hand hygiene compliance among nurses and doctors in medical and surgical wards: an eight-year observational study. J Hosp Infect. 2022;127:83-90. [Context Link]

 

12. Doukas FF, Cheong E, McKew G, Gray TJ, McLachlan AJ, Gottlieb T. Antimicrobial stewardship audit and feedback rounds: the impact of electronic systems and moving beyond the restricted antibiotic list. Intern Med J. 2021;51(11):1876-1883. [Context Link]

 

13. Gude WT, Brown B, van der Veer SN, et al Clinical performance comparators in audit and feedback: a review of theory and evidence. Implement Sci. 2019;14(1):39. [Context Link]

 

14. Alvarado N, McVey L, Greenhalgh J, et al Exploring variation in the use of feedback from national clinical audits: a realist investigation. BMC Health Serv Res. 2020;20(1):859. [Context Link]

 

15. The Leapfrog Group. Raising the bar for safer health care. http://www.leapfroggroup.org. Accessed November 26, 2022. [Context Link]