October 17, 2016

Anesthesia patient satisfaction hinges on safety, comfort, and communication

By: OR Manager
Share

Is it possible to adequately capture the experience of patients undergoing anesthesia when their awareness and perceptions are typically altered by their very experience?

A 5-year study of anesthesia patient satisfaction suggests that not only is it possible, but the results are meaningful in providing anesthesia-specific validation and in identifying opportunities for improvement.

These are two critical elements currently lacking in traditional patient experience surveys. Somnia Inc, a national anesthesia practice management organization in New Rochelle, New York, conducted the 5-year study, which correlated safety, comfort, and communication with patient satisfaction.

 

HCAHPS relevance

Hugh Morgan, MHA, CPHQ, CMPE

Hugh Morgan, MHA, CPHQ, CMPE

In the 1980s, healthcare organizations began conducting patient satisfaction surveys as a means of generating feedback to help guide their marketing and deliver a competitive advantage. It wasn’t until October 2006 that the patient survey trend became a national standard when the Centers for Medicare & Medicaid Services (CMS) implemented the National Quality Foundation (NQF)-endorsed HCAHPS (Hospital Consumer Assessment of Healthcare Providers and Systems) survey.

The HCAHPS survey is intended to provide a standardized survey instrument and data collection methodology for measuring, comparing, and publicly reporting patients’ perspectives on hospital care. Currently, this survey contains 21 patient perspectives on care and patient rating items that encompass nine key topics:

• communication with doctors

• communication with nurses

• responsiveness of hospital staff

• pain management

• communication about medicines

• discharge information

• cleanliness of the hospital environment

• noise level of the hospital environment

• transition of care.

The survey also includes four screener questions and seven demographic items, which are used for analytical purposes and to adjust the mix of patients across hospitals. Hospitals typically contract with CMS-approved vendors to conduct random surveys of patients by telephone and/or by mail.

It can be argued that HCAHPS is a patient experience rather than satisfaction survey tool in that it captures whether or not a service occurred and/or the frequency of the occurrence, rather than the patient’s level of satisfaction with the service.

Although no survey tool is perfect, HCAHPS often comes under scrutiny, especially from medical specialty providers, because of its broad, hospital-service based questions and low, non-statistically significant survey sample size.

 

Surgical patient feedback

Recognizing the need to capture information about the surgical patient experience, in 2009 the American College of Surgeons partnered with surgical and anesthesia organizations around the country to develop the S-CAHPS (Surgical Consumer Assessment of Healthcare Providers and Systems) survey that was eventually endorsed by the NQF in 2012.

The S-CAHPS survey contains 32 questions asking patients about their perioperative surgery experience and includes eight questions about anesthesia. Unlike the HCAHPS survey, however, the S-CAHPS survey is still very much in its infancy and not yet a CMS-mandated survey tool. Most hospitals are not using the survey, and there are no comparable, relevant data to report.

 

Anesthesia patient feedback

In recent years, anesthesia-specific patient surveying has been scrutinized as the industry further recognizes the impact and influence of anesthesia services on both acute care and surgical patients.

Researchers reviewed published studies conducted over 20 years that evaluated tools used to measure patient satisfaction with anesthesia services. Their most significant finding was that most studies did not use validated tools.

They concluded that although many organizations had attempted to conduct relevant anesthesia patient satisfaction surveys, most had missed the target—leaving the industry without a large-scale study and meaningful results.

These findings, along with the questionable relevance and application of the HCAHPS and S-CAHPS surveys, further reinforced that Somnia was on the right track in surveying patients about their satisfaction with anesthesia services.

 

Anesthesia-specific survey tool

Bearing in mind the need to construct a valid survey instrument, Somnia completed the stages and processes of psychometric development testing, which included:

• gathering opinions and data from anesthesia provider and patient focus groups

• piloting a survey

• modifying and re-testing the survey

• performing validity testing

• performing reliability testing

• measuring acceptability, including time to complete the survey and response rates.

The survey needed to be relevant and meaningful. Based on the provider and patient focus group feedback, Somnia identified five priority areas in which a patient needed to have a positive anesthesia experience: care/treatment, information/communication, safety/comfort, outcome, and timely/responsive care.

In designing the survey, Somnia viewed anesthesia patient satisfaction as a continuous flywheel in which the anesthesia care processes influence the outcome—which, in turn, influences patient satisfaction.

Somnia also approached survey development in terms of patient recall as patients tend to remember care they received just prior to and immediately following their surgical/anesthesia experience.

The survey grouped questions into three categories to measure a patient’s satisfaction at three stages:

• prior to the day of surgery during the preadmission testing processes

• on the day of surgery to gauge how the patient was received, communicated to, and interacted with

• following surgery to measure perceptions of the postsurgical anesthesia experience.

The final survey tool contained 13 questions—nine relating to the presurgical/anesthesia experience, and four regarding the postsurgical/anesthesia experience.

The survey is randomly administered via telephone by a national, CMS-approved survey vendor to avoid any inherent survey bias that might be encountered when using different survey modes.

The survey is typically conducted within 3 to 4 weeks following the surgical patient’s discharge. The goal is to achieve a statistically significant number of survey responses within a 95% confidence level.

Instead of measuring whether the patient received a specific anesthesia service, or the frequency of that service per the HCAHPS survey, Somnia’s survey incorporated the 5-point Likert scale ranging from “very satisfied” to “very dissatisfied” in order to capture the patient’s varying level of satisfaction with the anesthesia care. The Likert scale also provides a standardized basis of comparison at both the group practice and the individual anesthesia provider levels when analyzing results.

The survey and process were constructed to initiate automated, real-time communication via email to the anesthesia practice leadership if and when a patient requests to be contacted about his or her experience and/or any survey question that received a score of < 3 on the 5-point Likert scale.

Somnia’s survey was reviewed and approved by the CMS HCAHPS Project Team to ensure there were no issues or conflicts with the administration of a separate hospital-based anesthesia patient satisfaction survey.

 

Survey findings and observations

Somnia’s retrospective 5-year study, conducted between September 2010 and December 2015, consisted of nearly 30,000 anesthesia patient satisfaction surveys, of which 18,312 were submitted by surgical patients. The other surveys in this study were taken by obstetrics patients.

The hospital-based anesthesia patient satisfaction surveys presented both individual clinician mean percentiles and normative mean results.

For comparison purposes, Somnia studied multifacility or group-level summaries taken during the 5-year time frame. In the absence of national anesthesia-specific benchmarks for patient satisfaction, Somnia set a target at the >90th percentile for surgical patient surveys.

The overall results yielded an aggregate simple mean of 91.57 for all 13 questions and 93.29 for the question addressing the patient’s overall satisfaction with the anesthesia experience.

In addition to individual and summary findings, Somnia analyzed the data on a deeper level using the Pearson statistical correlation, which establishes the strength of the association or influence between individual survey question responses and overall satisfaction.

Typically, a correlation of >.60 is considered strong, influencing overall satisfaction. Four responses from the surgical patient satisfaction survey showed a significant correlation to the patient’s overall satisfaction with anesthesia services. The strongest correlations were with these statements:

• The anesthesia care team made me feel comfortable and safe (.66 correlation).

• I did not experience any anesthesia-related complications (.63 correlation).

• The anesthesia care team clearly explained to me what was being done (.62 correlation).

• The anesthesia care team clearly answered all of my questions/concerns (.61 correlation).

The correlation questions provide relevant feedback in that they allow the leadership and staff to focus on the specific experience/survey areas that, over time, are most important to the patient population receiving anesthesia services.

 

Lessons learned

The following are four significant lessons learned from this study:

• Specialty-specific patient satisfaction surveys are meaningful, relevant, and add value beyond the standard HCAHPS surveys.

Medical specialty providers, including anesthesia providers, are often perplexed by the abstract HCAHPS surveys. They can benefit from a well-constructed and well-administered specialty-specific survey that can either validate services or identify opportunities for improvement.

• Assumptions are not always accurate. Often times providers make assumptions about what they perceive to be important to patients, but without a relevant survey, it is often unclear as to what influences patient satisfaction.

In this study, it was assumed that postoperative pain or nausea and vomiting would likely be the two highest correlates of patient satisfaction when, in reality, patient safety and comfort prior to surgery were the highest corollaries.

• Communication has a significant influence on patient satisfaction. The study further confirmed what has been studied and published for years: Patients are most satisfied when they feel their providers are communicating with them.

Three of the four highest correlations of satisfaction were related to communication between the anesthesia provider and the patient.

• Real-time results are critical for ongoing improvement. A known flaw of HCAHPS surveys is that the data are often several months old by the time they are made available for review by those responsible for acting on the results. That is a significant lag given that by the time any review or strategic improvement plans are made, it is likely halfway through a given year.

This study found that having meaningful specialty-specific patient feedback available to leadership and staff within 3 to 4 weeks increased opportunities for responsive plans and ongoing improvement.

As the emphasis on patient experience continues to evolve, patient satisfaction surveys must be flexible to remain current and effective. This includes ensuring that survey tools achieve validation with psychometric testing, that surveys are relevant and meaningful for specific specialties, and that real-time feedback is given so that providers can make the changes needed to increase satisfaction.

Leadership discussions, peer mentoring, and scripting for better communication are steps that can be taken for improved outcomes and patient satisfaction with anesthesia care. ✥

 

Hugh Morgan, MHA, CPHQ, CMPE, is vice president, quality assurance, and executive director of Somnia Patient Safety Organization, Inc, New Rochelle, New York.

References

Barnett S F, Alagar R K, Grocott M P W, et al. Patient-satisfaction measures in anesthesia: Qualitative systematic review. Anesthesiology. 2013;119(2),452-478.

https://www.facs.org/advocacy/quality/cahps.

http://www.hcahpsonline.org/home.aspx.

Join our community

Learn More
Video Spotlight
Live chat by BoldChat