May 24, 2022

Results of competency assessment study of OR nurses in the US

By: James X Stobinski, PhD, RN, CNOR, CSSM(E), CNAMB, Shannon Maio, MA and Carissa L. Homme, PhD, PMP
Share

Perioperative nursing was the first recognized nursing specialty in the late 1800s. Modern education and training of nurses entering the specialty is still like this early period. Orientation is heavily reliant on workplace training and precepted learning experience. However, these long-standing methods have not been rigorously studied for effectiveness.

The US is not a world leader in the use of competency assessment instruments in nursing education and practice. Other regions such as Europe and Australia are more advanced in these methods. The use of competency assessment instruments in nursing specialties in the US has proven particularly challenging. Nurse leaders do not yet know all the factors that contribute to nursing competency, and the interactions between known variables are complex. There have also been few attempts to measure perioperative nursing competency using assessment instruments in the US. Such assessments are not an integral part of licensing or certification processes.

In an International Journal of Nursing Studies article on an OR competence model, the authors assert that in the perioperative setting, competence encompasses both technical and non-technical skills and behaviors. These authors maintain that a self-assessment instrument for perioperative nursing competence could help identify strengths and limitations, augment annual evaluations, and inform educational activities. They also state that competence assessment entails more than measuring the performance of tasks. While there may be tremendous potential for specialty specific competence assessment instruments, there is no current widely accepted instrument for perioperative nursing.

There is now some urgency to the issue of competence assessment. The need for OR nurses is increasing, and the spotty shortages previously seen in this specialty have been exacerbated by the ongoing pandemic and the predicted retirement of more experienced cohorts. Bringing large numbers of nurses into the specialty is necessary because the demand for surgery continues unabated even with the disruption of the pandemic. At the Competency and Credentialing Institute (CCI), there is anecdotal evidence of seasoned OR nurses leaving the profession in the record numbers of nurses transitioning their certifications to Emeritus status for the period 2019–2021.

 

Number of OR nurses in the US

The total number of perioperative nurses is historically an elusive figure, but this data is essential for education and workforce planning. The 2020 National Nursing Workforce Survey showcases CCI’s best current estimate of the number of American perioperative nurses. However, there are limitations for this data. Question 26 of the survey is: “Please identify the employment specialty that most closely corresponds to your primary nursing practice position.” Among the responses was “Perioperative,” but there were no further choices for subspecialties such as perianesthesia. In the absence of more definitive responses, it is likely that the nurses choosing the Perioperative response included all nurses working in the perioperative setting, including preoperative, intraoperative, and postoperative.

While this data is the best currently available, the relative numbers of nurses working in the three main perioperative areas would be more helpful for workforce planning. Another issue with this data is that the information on demographics is only available for the entire group of respondents. Thus, a breakdown of education attainment and age groups is not available for only the perioperative respondents.

The 2020 National Nursing Workforce Survey reveals that the total number of American RNs holding an active license is 4,198,031. These numbers, however, were pre-pandemic, and not every nurse with a license is actively working in nursing. Of these, 6.7% of the respondents chose the Perioperative specialty. This represents the third largest nursing category and an increase from 5.8% in the 2017 survey. The largest group of respondents was 13.4% for Acute/Critical Care, and the second largest was Medical-Surgical at 8.5%.

The survey also allows for respondents to select a secondary specialty. Here, 4.5% of respondents listed Perioperative as their secondary specialty. These respondents could be nurses in the Labor and Delivery setting or in an ambulatory setting who perform minor procedures. When calculating from the total number of nurses holding an active license, there are 281,268 nurses (6.7%) designating Perioperative as their primary specialty and 188,911 (4.5%) claiming Perioperative as their secondary specialty. Thus, CCI’s best current estimate is that a total of 470,179 RNs say that perioperative nursing is a significant part of their work duties. This total is 11.2% of RNs in the country, a substantial portion of the US nursing workforce.

 

Description of the study

In the April 2022 issue of OR Manager, CCI reported on the descriptive statistics from a research study completed in 2021, titled Investigation of Perioperative Nurses in the United States. The subjects in this study were RNs across the US in surgical services, including preoperative, intraoperative, and postoperative. The aim of the study was to investigate what factors influenced the self-perception of perioperative nursing competency when using the PPCS-R (Perceived Perioperative Competence Scale-Revised) instrument. The study utilized a quantitative cross-sectional design with descriptive and comparative components.

In this June 2022 article, CCI describes its findings regarding the correlation between selected demographic characteristics and the self-perception of perioperative nursing competency. This has implications for training and retaining OR nurses. The article will close with suggestions for future research.

 

Perioperative nursing competency

There are many assumptions regarding competency in American nurses. Chief among these assumptions is that of licensure. As Tilley (2008) aptly stated, “Currently, in most states, a nurse is determined to be competent when initially licensed, [and] continuing competency is assumed thereafter unless otherwise demonstrated.” A lack of standardized terminology also hampers research in this area with confusion around the terms competence, competency, and continuing competency.

Consistent with the work of Fukada (2018), CCI uses the term competence to refer to potential ability to perform in a role. Fukada explains competency as “a cluster of elements, including knowledge, skills, attitudes, thinking ability, and values that are required in certain contexts.” CCI agrees with Fukada in this holistic definition, which acknowledges that competency is multifaceted and includes both technical and “soft skills.” This complexity is part of the challenge for credentialing bodies like CCI as they attempt to establish competency assessment programs. CCI also agrees with Gillespie et al (2012) in that a self-assessment instrument for specialty specific competence may be helpful to perioperative nursing. This view of competency, and the very practical need to better understand the demographics of nurses eligible for and pursuing CCI credentials, informed CCI in performing this research.

 

Study Results

The typical CCI study respondent was a certified white female with 17 years of perioperative nursing experience and educated at the BSN level. The most common certification held was the CNOR certification from CCI, and most respondents worked at a short-term acute care hospital. The largest age group in this sample was in the 55–64 years of age band. There were 4,583 respondents to the survey, but rigorous exclusion criteria brought the number of respondents for this portion of the study to 3,821. To be included in this portion, respondents could not have more than one missing response in any of the PPCS-R subscales.

The respondents were also asked what type of orientation program they experienced upon entry to perioperative nursing. The results are below:

Type of Program Percentage of RespondentsPeriop 10123.80%Facility-developed program34.10%None 37.30%All other program types4.80%Total100%Table 1: Orientation program (n=3,821)

Perceived competence was measured with the PPCS-R instrument originally developed in Australia and validated for use with US nurses in subsequent work by CCI. The PPCS-R has 40 items that are rated on a 5-point Likert scale ranging from 1 point for a Never response per item to 5 points for an Always response. Overall scores range from 40 to 200, with higher scores indicating greater levels of self-perceived perioperative competence. The instrument also has six subscale scores in the following areas: Foundational Knowledge, Proficiency, Professional Development, Leadership, Collaboration, and Empathy. The revised scale has been used in Australia, Canada, and the UK, and it has demonstrated a high level of consistency in previous usage.

There were 3,821 respondents who completed both the demographic survey questions and the appropriate number of items on the PPCS-R survey. Generally, as we expected, there is an increase in each of the subscale scores as nurses accumulate more years of work experience. This pattern held true for each subscale except empathy, where no statistically significant relationship was found with years of experience. The subscale scores and the total PPCS-R scores for all participants are summarized in Table 2.

As with previous PPCS-R results with experienced nurses, the nurses rated themselves relatively high, with the average total PPCS-R score being 167.85. CCI then ran a series of statistical tests to determine if there were statistically significant correlations between selected characteristics, such as age or education, and either the total PPCS-R score or the subscale scores. Noteworthy findings for some of those correlations follow.

Here are two subscale definitions, according to Gillespie and Pearson (2013):

• Proficiency: “Behaviours that typify skills built on clinical exposure necessary to gain experience.”

• Foundational Knowledge and Skills: “Behaviours that reflect beginning technical skills, such as knowledge of instruments and procedures.”

The above subscales are the most closely linked to perioperative nursing hands-on clinical skills. The correlation of age groups and the subscale scores for Proficiency are presented below:

We hypothesized that age would correlate with Proficiency, which is evidenced in our findings. This assumes a direct relationship between age and years of perioperative nursing experience. As the age of OR nurses increased, and presumably their years of experience also increase, the Proficiency subscale score also increased. Each of these differences in age groups was statistically significant using an ANOVA (ie, analysis of variance) test.

We also examined the relationship between education levels and self-assessment scores. Using a One-Way ANOVA test, CCI examined the correlation between highest nursing degree held and Foundational Knowledge and Skills (Table 4). Here, the highest raw score in this subscale was for Associate degree nurses.

Although the use of competency assessment instruments is new to perioperative nursing, there may be a practical explanation for these results regarding Foundational Knowledge and Skills. It is possible that the work of Associate degree respondents is concentrated in hands-on clinical care and results in a subsequent high level of self-assessed competency in this area. Associate degree nurses may have lesser opportunities for leadership roles and thus concentrate and refine their skills in areas captured in this subscale.

Here are two additional examples that illustrate the potential for this research to contribute to education planning and competency assessments in perioperative nursing.

An examination of the relationship between educational achievement and the Leadership subscale results is presented in Table 5. Leadership scores increase as education levels rise. There is a statistically significant difference in scores between the respondents educated at the Master’s/Doctoral levels and the other degrees. This difference may be attributable to the professional roles held by these nurses, the nature of their daily work, and potentially more experience in leadership situations.

An examination of the total scores for the PPCS-R produced some noteworthy results, which are presented below. CCI gathered data on both highest degree held and highest nursing degree held. The results were similar in each correlation. Table 6 displays the results for a correlation with highest nursing degree held using ANOVA.

There is a rich trove of data in this first use of the PPCS-R instrument. CCI has related some key findings here, but a full examination of the findings is beyond the scope of this article.

 

Discussion

Studies of American perioperative nurses utilizing specialty-specific competency self-assessment instruments are limited. This is a pioneering study that also reveals rich opportunities for further research. Some of these findings were unexpected, and there were limitations to this research.

CCI originally hypothesized that baccalaureate or higher level of education combined with specialty certification would correlate with higher self-assessed levels of nursing competency. That was not the case. That hypothesis was based on earlier studies by authors Gillespie, Chaboyer, Wallis, and Werder reported in 2011. In that study, education levels and years of perioperative nursing experience were correlated to heightened self-assessed levels of competency. These authors also reported that years of experience had the largest influence on competency levels. In contrast, CCI’s results show no statistically significant differences between nurses having baccalaureate level education or higher and certification versus all other nurses.

Gillespie et al (2011) report that Australian perioperative nurses, from whom there are the most PPCS-R results, differ from American perioperative nurses in one key area. Australian perioperative nurses have access to a standardized post-licensure academic course offered at the university level for entry into the specialty. This level of education and training is not commonly available to American perioperative nurses; employer-developed programs are the dominant form of entry-level education in the US.

CCI found no statistically significant difference in overall PPCS-R score between certified and non-certified nurses. This counterintuitive finding was unexpected and should be evaluated with caution due to a relatively small number of non-certified nurses in this sample (n=701).

The two subscales most closely aligned to hands-on clinical skill, Proficiency and Foundational Skills, comprise 37.5% of the total PPCS-R score. Perioperative nursing has long valued clinical skill. The depth and breadth of cases in which perioperative nurses can scrub and circulate is held in high esteem. Nurses with high self-assessed scores in these areas may have higher overall scores. It may be that the relative contribution of hands-on clinical skills, as assessed in the Proficiency and Foundational Skills subscales, have a larger influence on perioperative specific competency than does an educational degree.

As previously discussed, the practice of competency assessment should be given serious consideration given the large number of nurses being sought to enter the specialty in a concentrated timeframe. Understanding the numbers of perioperative nurses, their demographic characteristics, and how these characteristics contribute to professional competency have the potential to increase the profession’s ability to engage in workforce planning and prepare new nurses. Until very recently, the number of perioperative and perianesthesia nurses was not known with any certainty. There is now more information, but the current data does not paint a complete picture.

 

Conclusion

ORs are facing nursing shortages while demand for surgery increases and experienced perioperative nurses retire. The 2020 National Nursing Workforce Survey gave some data on the perioperative nursing workforce, but more detail is needed for effective workforce planning and training programs for the specialty. The orientation process for nurses entering the perioperative specialty has not been extensively studied, but establishing the competency of perioperative nurses is a necessity in that process.

This is the first large scale study using a validated competency assessment instrument specific to the perioperative nursing specialty for American nurses. While these findings are informative, there is much yet to learn at this very early stage of using perioperative specific competency assessment instruments.

 

—James X Stobinski, PhD, RN, CNOR, CSSM(E), CNAMB, is CEO of the Competency and Credentialing Institute (CCI). Shannon Maio, MA, is a statistician, and Carissa L. Homme, PhD, PMP, is senior manager, test development and certification, at CCI.

References

Fukada M. Nursing competency: definition, structure and development. Yonaga Acta Medica. 2018;61(1):1-7.

 

Gillespie B M, Pearson E. Perceptions of self-competence in theatre nurses and operating department practitioners. ACORN. 2013;26:29-34.

 

Gillespie B M, Polit D F, Hamlin L, et al. Developing a model of competence in the operating theatre: Psychometric validation of the Perceived Perioperative Competence Scale-Revised. Int J Nurs Stud. 2012;49(1):90-101.

 

Gillespie B M, Chaboyer W, Wallis M, et al. Education and experience make a difference: results of a predictor study. AORN Journal. 2011;94(1):78-90.

 

Smiley R A, Ruttinger C, Oliveira C M, at al. The 2020 National Nursing Workforce Survey. J Nurs Reg. 2021;12(4) Supplement:S4-S6.

 

Stobinski J X, Maio S, Homme C. Select demographics of nationwide sample of OR nurses. OR Manager. 2022;38(4):20-23.

 

Stobinski J X. Becoming a perioperative nurse: The historical context. OR Today. December 31, 2020.

 

Stobinski J X. The four assumptions of nursing competency. OR Today. December 1, 2021.

 

Tilley D S. Competency in nursing: a concept analysis. J Contin Educ Nurs. 2008;39(2):58-64.

Join our community

Learn More
Video Spotlight
Live chat by BoldChat