Development of a questionnaire assessing nursing staff’s knowledge, attitude, and practice on the prevention of the nosocomial infection in elderly patients:testing reliability and validity?

Fu-Lin Ci, Xiu-Feng Chen,*, Yong-Xin Wng

aNursing Department, The First Affiliated Hospital of Anhui University of Science and Technology (Huainan First People’s Hospital), Huainan,Anhui 232007, China

bDepartment of Postgraduates, Bengbu Medical College, Bengbu, Anhui 233030, China

Abstract: Objective: To develop a questionnaire assessing nursing staff’s knowledge, attitude, and practice on the prevention of the nosocomial infection in elderly patients and test its reliability and validity.

Keywords: nurse ? Delphi method ? elderly patient ? nosocomial infection ? questionnaire

1. Introduction

According to statistics from the National Health Commission of the People’s Republic of China, in 2014,there were 212.24 million elders in China, accounting for 15.50% of the total population. As of now, the number of China’s elderly people over 60 years old has reached nearly 250 million. Among them, more than 40 million elderly people are disabled.1Elderly people, consequent to the growing life expectancy, changing population structure, and improved medical insurance policies,require a greater hospital capacity in terms of size and quality. Meanwhile, nosocomial infections are difficult to prevent.2Infections which occur in the respiratory tract,urinary tract, skin, and soft tissues remain the focus of geriatric care in hospitals and cause difficulties in hospital management in many countries.3As elders advance further in age, their immune systems undergo degradation, and this degradation, on some occasions, causes chronic diseases, frequently-occurring diseases, cancer,and immobility, thereby further increasing their chances of developing infections.4Being a main contributor to patients’ physical deterioration and death,5infections consume more medical resources and make patients suffer both physically and financially.6

Every link involved in infection prevention and control including disinfection, quarantine, aseptic operation,rational use of antibacterial drugs, and monitoring,7,8according to the World Health Organization (WHO), is closely related to nursing work. Nurses are the most direct and continuous participants in the execution of nursing procedures, and they are responsible for the execution of every aspect of nursing work. Therefore,they are qualified to make recommendations and ought to be provided with adequate opportunities to contribute to the primary prevention of infections through evidence-based practices.9There are literature, home and abroad, assessing nurses’ knowledge, attitude,and practice in relation to nosocomial infections.10,11There is, however, a severe limitation in the amount of literature which delves into nurses’ knowledge and attitude on how to prevent nosocomial infections in elderly patients.12Besides, no questionnaires are found to evaluate nurses’ performance in this regard. Yet,obtaining this information will help safeguard elderly patients from infections in hospitals. This study, therefore, aims to design a questionnaire assessing nurses’ knowledge, attitude, and practice on nosocomial infections in elderly patients, inspire nursing educators and managers for their targeted key performance indicator(KPI) and, above all, reduce the incidence of nosocomial infections in elderly patients.

2. Methods

2.1. Sample

To ensure the reliability and validity of the questionnaire, interviewees should be 5–10 times13the number of questionnaire items. The sample size should be further expanded by 10.00%, given the possibility that there may be invalid responses and given the conduct of exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). There are 38 items in the final version of the questionnaire. 700 copies are distributed and 692 (98.86%) collected. Excluding invalid questionnaires, 681 are left with an efficiency rate of 97.29%,which is in line with the designated sample size. The 681 copies are then randomly divided into two groups(N1= 341,N2= 340).

Sample inclusion criteria: (1) Nurses who have worked in the adult clinical department for ＞1 year and obtained the nursing qualification certificate, and (2)nurses who voluntarily participate in the study.

Sample exclusion criteria: (1) Interns, visiting students, students who have not passed the Standardized Training of Residents exam and those who have not yet obtained professional qualification certificates, and(2) nurses working in such departments as pediatrics,neonatology, obstetrics, and gynecology, without elderly patients.

2.2. Questionnaire design

2.2.1. Structure of the questionnaire

According to Ajzen’s Health Belief Model14(Figure 1),nursing staff’s knowledge and beliefs about nosocomial infections of elderly patients are shaped by cognition.15Nurses should know about basic nursing practice,clinical knowledge, compliance awareness, infection prevention, and control.16Obtaining knowledge and information about elderly patients constitutes their personal expertise and know-how. In this process, nursing staff’s formed attitude towards the prevention of nosocomial infections and exercise of control over elderly patients helps form the latter’s right infection-prevention behaviors such as good hand hygiene.17

2.2.2. Development of questionnaire items

Based onDiagnostic Criteria for Nosocomial InfectionandStandard Operation Procedures for Prevention and Control of Nosocomial Infection, this paper searches for literature about nurses’ knowledge, attitude, and practice on preventing nosocomial infections in elderly patients in databases such as PubMed,Medline, CNKI, CQVIP, and China info. Thereafter, it develops 68 items for the questionnaire, considering physical and psychological features of elderly patients and the fieldwork experience for infection prevention in elderly people. The items are categorized into three dimensions: 38 for knowledge, 14 for attitude, and 16 for practice.

Figure 1. Health belief model.

2.2.3. Delphi method

From January to April, 2019, two rounds of expert inquiries were conducted via email and on-site investigation. The first round of inquiry focuses on the following aspects: (1) introducing the research question and significance of this study; (2) assessing the importance and feasibility of each item in the questionnaire with a 5-point scale (5 = very important, 1 = least important); (3) experts’ suggestions towards each item; and(4) sociodemographic information associated with the experts (age, gender, professional title, years of service,etc.). After this, the second round of expert inquiry was conducted based on the revised inquiry from the first round. Ultimately, 20 items were deleted and 11 were revised. The final version of the questionnaire consists of 3 dimensions with 38 items: 18 for knowledge, 10 for attitudes, and 10 for practice.

2.3. Pilot study

The feasibility of this questionnaire is determined by a pilot study of approximately 30 subjects.18The points to consider while determining feasibility include time taken to fill the questionnaire, simplicity of the format, clarity of the questions, ease of scoring, and result interpretation. Thirty copies of the questionnaire were distributed following a convenience sampling method to nursing staff for a pilot study with 14–17 min for filling-in. The preliminary survey turned out to be satisfying since all of the mentioned aspects were acceptable to participants.

2.4. Questionnaire survey

The questionnaire consists of two parts: participants’ sociodemographic information (department, gender,age, education, professional title, years of service, etc.)and their knowledge, attitude, and practice in relation to the prevention of nosocomial infections in elderly patients. 18 items are designed for assessing nurses’ knowledge in this regard (1 = right answer, 0 = unanswered or incorrect answer). 10 items review nursing staff’s attitude through a Likert-4 scale (4 = very important, 1 = least important). For the rest of the 10 items,participants’ practices are evaluated with “never,” “sometimes,” and “always.” The three options are counted 1, 2,and 3 points, respectively. Notably, there are “reversed items” in this dimension, meaning the higher the score is, the better the nurse’ s practice is towards infection prevention in elderly patients.

2.5. Data collection

In this study, six trained investigators who were evenly grouped into 3 sub-groups, participated in distributing and collecting the questionnaires. When investigators handed out the questionnaires, they explained the purpose and precautions of the investigation to the respondents. After the respondents filled out the questionnaires, they recalled them on the spot, numbered each copy, and excluded invalid ones to ensure that the feasibility and validity of the data obtained from the survey were not adversely affected.

A total of 700 copies of this questionnaire were distributed following a convenience sampling method to clinical nurses simultaneously, and 692 were collected(98.86%). After excluding invalid ones, 681 (97.29%)valid questionnaires were studied. Of all the participants, 334 (49.04%) are from the department of internal medicine and 347 (50.96%) are from the department of surgery.

2.6. Data analysis

This study aims to test the reliability and validity of a designed questionnaire that assesses nurses’ knowledge,attitude, and practice on preventing nosocomial infections in elderly patients. To this end, Epidata 3.1 is used to input data and SPSS22.0 and AMOS 22.0 are used to analyze them. The basic findings are described through the constituent ratio. Further, the reliability and validity of the questionnaire are observed through Cronbach’s α coefficient, test–retest reliability, content validity index (CVI),EFA, correlation coefficient and CFA.19

3. Results

3.1. Experts inquiry

3.1.1. Sociodemographic information of the experts

The experts selected in this study come from nine firstclass hospitals that are situated across three regions of Anhui Province. They are all experienced in the prevention and control of the nosocomial infection. The basic information pertaining to the experts is presented in Table 1.

Table 2. Expert authority coefficient.

Table 1. Experts’ sociodemographic information.

3.1.2. Experts’ enthusiasm towards and the authority of the study

Experts’ enthusiasm towards the study is shown by how many questionnaires are collected after being distributed.20 In this study, 15 questionnaires are distributed in each round. 15 (100.00%) copies, subsequently, in each round are found to be collected, suggesting a high level of zeal towards this study among all experts who participated in it. The authority of this study is notated by Cr, which is determined by the coefficient of determination (Ca) and experts’ familiarity (Cs) in this field.21 The expert authority coefficient (Cr) is calculated with Cr = (Ca + Cs)/2, as is shown in Table 2.

3.2. Reliability and validity tests

3.2.1. Cronbach’ s α coefficient

3.2.2. Exploratory factor analysis

The questionnaires are randomly divided into 2 groups,and the EFA (N1= 341) and CFA (N2= 340) are carried out. To test if the three factors are consistent with the general questionnaire, EFA is conducted on knowledge,attitude, and practice to compare the result with that of the questionnaire.

Knowledge

The Kaiser–Meyer–Olkin (KMO) statistic is 0.718 (＞0.7)and Bartlett’s test is ＜0.001 in this dimension, suggesting adequacy for factor analysis. Varimax with Kaiser normalization is thereafter applied to extract 5 factors from 18 items. The 5 factors are the basic knowledgeof nosocomial infection in elderly patients F1 (K1–K5),clinical knowledge F2 (K6–K9), infection prevention F3 (K10–K12), infection control F4 (K13–K15), and compliance awareness F5 (K16–18). According to our calculation, a total of 78.486% variance is explained.The detailed information regarding this is shown in Table 4.

Table 3. Reliability-testing statistics (N = 681).

Attitude

The KMO (0.906) and Bartlett’s test (P＜ 0.001) in this dimension suggest a fit for factor analysis. One factor is extracted from 10 items through the varimax rotation.A total of 55.455% variance is explained in this aspect.The detailed information is shown in Table 5.

Practice

徐宿淮鹽高鐵是江蘇腹地最重要的鐵路大動脈之一，全程設計行車速度為250公里/小時，預計2019年年底建成通車?？缧卵蟾坌崩瓨蛭挥谛卵蟾叟c通榆河交界的喇叭口處，橫跨新洋港河，緊鄰既有新長鐵路線。主橋全長650米，橋梁跨越點河道水面寬240米。橋塔結構復雜，主塔采用H形花瓶式混凝土塔，塔高128.5米，主跨312米。

In terms of practice, factor analysis is also successfully carried out as the KMO (0.817) and Bartlett’s test(P＜ 0.001). Two factors, subsequently, are extracted from 10 items. They are standard prevention and control F6 (P1–P4) and hand hygiene F7 (P5–P10). A total of 62.974% variance is explained and detailed information is shown in Table 6.

Questionnaire

The nursing staff’s KMO is 0.762 and Bartlett’s test of the questionnaire is ＜0.001, and 8 factors are extracted from 38 items using varimax rotation. The 8 factors involve nursing staff’s knowledge, attitude, and practice towards nosocomial infections in elderly patents. Among these factors, factor 1 pertains to attitude, factor 2 to basic knowledge (F1), factor 4 to clinical knowledge(F2), factor 6 to infection prevention (F3), factor 7 to infection control (F4), factor 8 to compliance awareness(F5), factors 5 to standard precaution (F6), and factor 3 to hand hygiene (F7). A total of 69.536% variance is explained in this regard. The dimensional structure constructed is consistent with the premeditated structure.For specific results, see Table 7.

Table 4. Component matrix＊ of knowledge.

Table 5. Component matrix＊ of attitude.

Table 6. Component matrix＊ of practice.

3.2.3. Confirmatory factor analysis

Structural Equation Modeling (SEM) is essentially a path analysis on latent variables.21Each variable in the path model is measured by multiple indicators to evaluate the effectiveness and reliability of the structure. Taking F1–F5 (knowledge), F6 (attitude), and F7(practice) as latent variables, 38 items as observed variables, this study, using AMOS 22.0, draws a second-order equation path diagram and compares it to the data of the other group (N2= 340) to verify the theoretical structure of EFA. The loading of each item under the relevant factor exceeds 0.4 and the difference is statistically significant (P＜ 0.050), as shown in Figure 2.

Table 7. Component matrix＊ of the questionnaire.

Figure 2. Path diagram of nursing staff’s knowledge, attitude, and practice on nosocomial infections (N2 = 340).

In terms of goodness of fit, the absolute fit index is adopted for the structural evaluation of knowledge, attitude, and practice. The following is what the study finds: χ2/df ＜ 5, goodness-of-fit index (GFI)＞0.8,adjusted goodness-of-fit index (AGFI)＞0.9, root mean square error of approximation (RMSEA)＜0.08, normed fit index (NFI)＞0.8, and comparative fit index (CFI)＞0.9.These indicators suggest that the model fits fairly well(Table 8).

Table 8. GFI indicators for confirmatory factors (N = 681).

3.2.4. Correlation analysis

Correlation analysis reflects the degree of correlation among dimensions and between each dimension and the questionnaire. It can be seen from that the correlation coefficient among dimensions is 0.09–0.34, which is lower than the coefficient between each dimension and the questionnaire (0.42–0.68). All dimensions have a weak or moderate correlation with each other, while each dimension also has a high correlation with the questionnaire. The correlation coefficient is 0.18–0.48 between knowledge, attitude, and belief, showing a moderate degree of correlation. The correlation coefficient between each dimension and the questionnaire is 0.67–0.69, suggesting a high degree of correlation(Table 9 and Table 10).

3.2.5. Content validity index

CVI evaluates whether the designed item can accurately describe the content or theme to be measured.22Typically, the validity is based on expert comment.CVI is sub-categorized into item-level CVI (I-CVI)and scale-level CVI (S-CVI). I-CVI = the number of the experts scoring 4 or 5 for the importance of the research/total number of the experts. S-CVI = the number of items with a 4 or 5 scores/total number of items.23In this research, the I-CVI is 0.73–1.00 and the S-CVI is 0.88.

Table 9. Correlation analysis between each variable and the questionnaire (N = 681).

Table 10. Correlation analysis between each dimension and the questionnaire (N = 681).

4. Discussion

4.1. Validity of the questionnaire content

Nursing staff’s knowledge, attitude, and practice on the prevention of the nosocomial infection in elderly patientsis designed based on the principles of objectivity and completeness, and has a guiding value. The questionnaire also considers the physiological and psychological characteristics of elderly patients, focusing on the knowledge nursing personnel need to master to prevent nosocomial infections in elderly patients.Finally, 38 items are designed to cover knowledge, attitude, and practice after modifying items in processes such as 2 rounds of Delphi expert consultation and pilot study. The final version of the questionnaire is distributed to 700 clinical nurses, and 681 (97.29%)copies are collected. The questionnaire is completed within 17 min. CVI is an important indicator reflecting the extent to which a variable measures the parameters which it is intended to measure. In this study, the results of the experts’ inquiry are used as a benchmark for content validity. The expert authority coefficient is 0.91; I-CVI 0.73–1.00, and S-CVI 0.88, suggesting this study is highly scientific.

4.2. Reliability and validity of the questionnaire

The reliability of this study is observed through Cronbach’s α coefficient and test–retest reliability, and the validity mainly through CVI and factor analysis. The Cronbach’s α coefficient of knowledge, attitude, practice, and the questionnaire surpass 0.7, indicating a good internal consistency. The retest is conducted 3 weeks later and the Cronbach’s α coefficient of the questionnaire exceeds 0.7, showing sound stability and reliability.24The higher the cumulative variance contribution rate of common factors, the greater the accuracy with which the total variance can be explained.25The variance contribution rate of the questionnaire and each dimension is between 55.455% and 78.486%, indicating that the variation of variance can be explained effectively. The factor loading of each item in each dimension exceeds 0.4 after factor analysis. The KMO and Bartlett’s test of each dimension and the questionnaire are ＞0.7; the correlation coefficient among dimensions and between each dimension and the questionnaire ＞0.3, suggesting a high degree of correlation.

CFI is applied to verify the theoretical structure of the exploratory factors. The following is what the study finds: c2/df ＜5, GFI＞0.8, AGFI＞0.9, RMSEA＜0.08,NFI＞0.8, and CFI＞0.9. These indicators corroborate the assumption that the model will fit well.26

To summarize, the designed questionnaire has good reliability and validity, and can reflect nurses’ knowledge,attitude, and practice on preventing and controlling nosocomial infections in elderly patients. Future studies can enlarge the sample size and use the questionnaire after testing its content and structure.

4.3. Feasibility of the questionnaire

As the risk of nosocomial infections in elderly patients increases, higher demands are placed on nurses in the prevention and control aspects of nursing work.The implementation of these requirements is inseparable from the nurses’ knowledge of nosocomial infections. This questionnaire is constructed by following the Knowledge–Attitude–Practice (KAP) model for measurement. The layout and content of the questionnaire is reasonable and stable. For example, the filling-in time spans 14–17 min. The assessment of nursing staff’s knowledge about nosocomial infections of elderly patients can be identified without taking too much time because the options available are plain and clear. This questionnaire is a practical and convenient evaluation tool that should be accessible to hospital infection managers.

5. Conclusions

As elders advance further in age, their body functions and immunity decline, in consequence making them targeted groups for nosocomial infections. Nursing staff face a more daunting task and should meet higher requirements when caring for elderly patients.27Nursing staff’s knowledge, attitude, and practice on the prevention of the nosocomial infection in elderly patientshas been developed to investigate nurses’ knowledge, attitude and practice on nosocomial infection in elderly patients to inspire hospital managers in their teaching and evaluation work and prevent the occurrence of nosocomial infections.

Acknowledgments

We thank Prof. David Bruce of the University of Dundee and Prof. Dwi Tyastuti of the University of Tokyo for their insights and advice.

Ethical approval

Ethical issues are not involved in this paper.

Conflicts of interest

All contributing authors declare that no conflicts of interest exist.