|
 |
| SHORT COMMUNICATION |
|
| Year : 2017 | Volume
: 22
| Issue : 1 | Page : 78-80 |
|
OSCE vs. TEM: Different approaches to assess clinical skills of nursing students
Prasuna Jelly, Rakesh Sharma
Faculty of Nursing, College of Nursing, All Institute of Medical Science, Raipur, Chattisgarh, India
| Date of Web Publication | 14-Mar-2017 |
Correspondence Address:
Rakesh Sharma
Faculty of Nursing, College of Nursing, All India Institute of Medical Science, Raipur, Chattisgarh
India
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/ijnmr.IJNMR_107_16
Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE) could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM) was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001). The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM. Keywords: Clinical skills, India, nursing students, OSCE, traditional examination method
How to cite this article:
Jelly P, Sharma R. OSCE vs. TEM: Different approaches to assess clinical skills of nursing students. Iranian J Nursing Midwifery Res 2017;22:78-80 |
| Introduction | |  |
The objective structured clinical examination (OSCE) is a method in which students are assessed for clinical skills in a series of simulated stations that may involve history collection, physical assessment, laboratory investigation, and treatment.[1]
Traditional evaluation methods (TEM), such as oral viva, written assignment, multiple choice questions, and clinical observational reports, are often used in the assessment of medical students. These TEM systems have poor reliability and validity in terms of practicality.[2],[3],[4] On the other hand, OSCE has been found to better assess clinical and cognitive skills of graduate medical students.[5],[6]
The conventional clinical and practical examination are overwhelmed with several problems. OSCE is a modern type of examination often used in health sciences (e.g., medicine, physical therapy, nursing, pharmacy, etc.) to test clinical skill performance such as communication, clinical examination, medical procedures or prescription, and exercise prescription.[7]
The objectives of the study were to assess the skills of final year B. Sc. nursing students in providing antenatal care by OSCE and TEM, and to get opinion of evaluators and final year B. Sc. nursing Students regarding OSCE and TEM.
| Materials and Methods | | |
An evaluative-comparative research was conducted by adapting posttest only design among 37 final year B. Sc. nursing students in selected institutions of Nursing. Tools used for data collection were an observational checklist regarding antenatal care (ANC) and an opinionnaire on the usefulness of OSCE and TEM. Content validation was done by experts and reliability was established. Interrater reliability method was used for observational checklist (r = 1). A pilot study was conducted and the study was found to be feasible.
To evaluate participants at different OSCE stations and TEM, eight clinical instructors (CIs) were selected from OBG Nursing Department, with 1 year of experience. All the CIs and students were briefed regarding ANC, and blueprint of TEM and OSCE methodology was explained.
Data were collected in a series of skill assessment followed by obtaining opinion. There was a 20-day gap in the assessment of skills between TEM and OSCE on the basis of memory curve. Data analyses were done by using descriptive and inferential statistical methods.
Ethical considerations
Ethical approval was taken from institutional ethical committee. The aim of the study was explained to the students and a written informed consent was obtained.
| Results | | |
The majority of participants 32 (86.5%) scored high in skills when evaluated by OSCE than TEM. The interesting fact which was observed was that none of the participants scored less than 50 when evaluated by OSCE, whereas mostly [24 (64.86%)] members scored below 50 with TEM (maximum possible score was 75).
The means (SD) of OSCE and TEM skills scores were 65.43 (3.43) and 46.02 (7.57) against the maximum possible scores of 75 and 75 for OSCE and TEM. The skills scores evaluated by OSCE and TEM was found significant [t (cal) = 15.77 at 0.001 level of significance] [Table 1]. | Table 1: Difference in clinical skills score assessed by OSCE and TEM (n=37)
Click here to view |
The results regarding the opinion of nursing students showed that both were in favor of OSCE than TEM as the method of clinical skills evaluation, which was significant at 0.001 level (McNemar's test), except item no. 7 and 9 [Table 2]. | Table 2: Opinion of nursing students on usefulness of TEM and OSCE (n=37)
Click here to view |
Data regarding opinion on the usefulness of TEM and OSCE by evaluators revealed that there was 100% agreement toward the usefulness of OSCE as an evaluation method in items 7 and 10, whereas in TEM agreement was only 12.5% and 75%, respectively [Table 3].
| Discussion | | |
The present study aimed to compare OSCE and TEM in assessing the skills of nursing students and to obtain opinion about OSCE and TEM from participants and evaluators of OSCE.
The skills scores evaluated by OSCE were significantly better than that of the TEM skills scores [paired (36) = 15.770 at 0.001 level]. Similar findings [8] have shown that the experimental group had a greater improvement in performance evaluated by OSCE than the control group at 13.43% compared with 6.76% (P< 0.05). It can be concluded that the difference of mean observed was the true difference, and that the OSCE method is effective than TEM as an evaluation method.[9],[10]
It was noted that the evaluators and nursing students were in favor of OSCE as an evaluation method than TEM, which was found to be significant at 0.001 level, except item numbers 7 and 9 by the nursing students. These findings are consistent with the findings of another study.[11]
| Conclusion | | |
The findings of the present study concluded that the skills of final year B. Sc nursing students evaluated by OSCE was higher than the score of TEM. The study findings point toward the significance of self-directed and student-centered innovative evaluation methods in nursing education.
Acknowledgement
We would like to sincerely thank the students of Himalayan College of Nursing, Dehradun for participating in this study and faculty members for their support and guidance.
Financial support and sponsorship
Nil.
Conflicts of interest
The authors have no conflicts of interest.
| References | | |
| 1. | Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of Clinical Competence using Objective Structured Examination. Br Med J 1975;1:447-51.  |
| 2. | Matsell DG, Wolfish NM, Hsu E. Reliability and validity of the objective structured clinical examination in paediatrics. Med Educ 1991;25:293-9. |
| 3. | Maxim BR, Dielman TE. Dimensionality, internal consistency and interrater reliability of clinical performance ratings. Med Educ 1987;21:130-7. |
| 4. | Schwartz RW, Donnelly MB, Sloan DA, Johnson SB, Strodel WE. The relationship between faculty ward evaluations, OSCE, and ABSITE as measures of surgical intern performance. Am J Surg 1995;169:414-7. |
| 5. | Sloan DA, Donnelly MB, Schwartz RW, Strodel WE. The objective structured clinical examination. The new gold standard for evaluating postgraduate clinical performance. Ann Surg 1995;222:735-42. |
| 6. | Carraccio C, Englander R. The objective structured clinical examination: A step in the direction of competency-based evaluation. Arch Pediatr Adolesc Med 2000;154:736-41. |
| 7. | Ananthakrishnan N. Objective structure clinical/practical examination (OSCE/OSPE). J Postgrad Med 1993;39:82-4. [ PUBMED] |
| 8. | |
| 9. | Schoonheim-Klein ME. Implementing an Objective Structured Clinical Examination (OSCE) in dental education: Effects on students' learning strategies. J Adv Nurs 2009;65:1584-95. |
| 10. | Paul F. An exploration of student nurses' thoughts and experiences of using a video-recording to assess their performance of cardiopulmonary resuscitation (CPR) during a mock objective structured clinical examination (OSCE). J Adv Nurs 2009;65:1584-95. |
| 11. | Eftekhar H, Labaf A, Anvari P, Jamali A and Moghaddam FS. Association of the pre-internship objective structured clinical examination in final year medical students with comprehensive written examinations. Med Educ Online 2012;17:159-8. |
[Table 1], [Table 2], [Table 3]
| This article has been cited by | | 1 |
“Evaluation of Simulation Using Objective Structured Clinical Examination (OSCE) Among Undergraduate Nursing Students: A Systematic Review” |
|
| Maysa Fareed Kassabry | | International Journal of Africa Nursing Sciences. 2023; : 100553 | | [Pubmed] | [DOI] | | | 2 |
Objective structured clinical examination vs traditional clinical examination to evaluate studentsæ clinical competence: A systematic review of nursing faculty and studentsæ perceptions and experiences |
|
| Sophia Cyril Vincent,Judie Arulappan,Anandhi Amirtharaj,Gerald Amandu Matua,Iman Al Hashmi | | Nurse Education Today. 2021; : 105170 | | [Pubmed] | [DOI] | | | 3 |
Transformation in nursing education in India: Current issues |
|
| Shweta Garadi,Rakesh Sharma,Prasuna Jelly,Ruchika Rani | | IP International Journal of Medical Paediatrics and Oncology. 2021; 7(3): 115 | | [Pubmed] | [DOI] | | | 4 |
Objective Structured Clinical Examination (OSCE) on Antenatal Assessment among Nursing students |
|
| Vijayalakshmi. S,Deiva K,Kathyayani B.V | | Asian Journal of Nursing Education and Research. 2021; : 401 | | [Pubmed] | [DOI] | | | 5 |
A Phenomenological Study to Explore the Challenges in Mental Health Nursing OSCE pattern of examination among B. Sc. Nursing III year students in Dhanvantri College of Nursing at Namakkal |
|
| Sampoornam. W | | International Journal of Advances in Nursing Management. 2021; : 325 | | [Pubmed] | [DOI] | | | 6 |
Experiences of using an OSCE protocol in clinical examinations of nursing students - A comparison of student and faculty assessments |
|
| Patrik Lyngå,Italo Masiello,Klas Karlgren,Eva Joelsson-Alm | | Nurse Education in Practice. 2019; 35: 130 | | [Pubmed] | [DOI] | | | 7 |
Mitigating the Challenges of Objective Structured Clinical Examination (OSCE) in Nursing Education: A Phenomenological Research Study |
|
| Cordelia Obizoba | | Nurse Education Today. 2018; 68: 71 | | [Pubmed] | [DOI] | |
|
 |
|
|
|
Search Pubmed for