Open Access Open Access  Restricted Access Subscription Access

Medical Students’ Perception of a Newly Implemented Objective Structured Clinical Examination (OSCE) in Orthopedic Surgery and Trauma: A Mixed-Method Study


Affiliations
1 Orthopedic Surgery and Trauma Department, Faculty of Medicine, SUEZ Canal University, Ismailia, Egypt
2 College of Medicine and Medical Sciences, Arabian Gulf University, Manama, Bahrain
3 Medical Education Department, Faculty of Medicine, SUEZ Canal University, Ismailia, Egypt
4 Ibn Sina National College for Medical Studies, Jeddah, Saudi Arabia
 

Introduction: Objective Structured Clinical Examination (OSCE) is a well-known, widespread method of assessment of clinical skills. It is being widely used in Egyptian medical schools. This study aimed to explore the perception of the fifth-year medical students on the attributes, quality, validity, reliability and organization of the end-of-rotation Orthopedics Surgery and Trauma OSCE held at FOM-SCU in two academic years (2017-2018 and 2018-2019). It also aimed to assess the students rating of OSCE in relation to the other available assessment methods in clinical rotations. Material and Methods: This is a cross-sectional mixed-method study that was conducted at Suez Canal University Hospital. A convenient sample of the fifth-year medical students, who underwent the OSCE at the end of their Orthopedic Surgery and Trauma rotation during both academic years 2017-2018 and 2018-2019 were involved (n = 254). Quantitative data were collected through a validated questionnaire consisting of 32 items. Focus group discussions of students were conducted and qualitative data were recorded, coded, and thematically analyzed. Results: More than half of the students (55.5%) believed that the exam was fair and covered a wide range of knowledge (63.8%) and clinical skills (72.4%). Considerable percentages of students were doubtful regarding the standardization of OSCE scores (62.6%) and whether those scores provided a true measurement of their clinical skills (65%) and more than half of them were not sure whether gender, personality, or ethnicity affected their exam scores (55.5%) and whether OSCE provides them practical and useful experience (53.5%). OSCE and portfolio were reported as the easiest method among 55.5% and 63.8% of students, respectively, and 31.1% rated MCQs as the most difficult form of assessment. Qualitative analysis identified two themes; namely: “Challenges of implementing OSCE” and “Ways to overcome identified challenges”. Conclusion: Medical students positively perceived and provided good perception on the organization and implementation of the Orthopedics OSCE, although some of them were doubtful regarding its validity and reliability in assessing their clinical skills in Orthopedics and Trauma. The challenges regarding the OSCE can be overcome by more well-structured, practical training and orientation sessions for the examiners, students, and simulated patients.

Keywords

Clinical Skills Assessment, Competency-Based Education, Orthopedics and Trauma, OSCE; Students’ Perceptions.
User
Notifications
Font Size


  • Abdel Nasser A, Sharif A F, Elkhamisy F A, et al. Medical Community Perspectives Regarding the Egyptian Medical Licensing Exam: A Mixed-Method Study. Cureus. 2021;13(4): e14636. https://doi.org/10.7759/cureus.14636
  • Liu M, Huang Y-S, Liu K-M. Assessing Core Clinical Competencies Required of Medical Graduates in Taiwan. Kaohsiung J Med Sci. 2006;22:475–83. https://doi.org/10.1016/s1607-551x(09)70341-9
  • Hsieh M-C, Cheng W-C, Chen T-Y. Objective Structured Clinical Examination (OSCE) including critical simulation: Evaluation of medical student competence. Tzu Chi Med J. 2014;26:40–3. https://doi.org/10.1016/j.tcmj.2013.08.001
  • Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65:S63-7. https://doi.org/10.1097/00001888-199009000-00045
  • McGaughey J. Standardizing the assessment of clinical competence: an overview of intensive care course design. Nurs Crit Care. 2004;9:238–46. https://doi.org/10.1111/j.13621017.2004.00082.x
  • Defloor T, Van Hecke A, Verhaeghe S, Gobert M, Darras E, Grypdonck M. The clinical nursing competences and their complexity in Belgian general hospitals. J Adv Nurs. 2006;56:669–78.
  • https://doi.org/10.1111/j.1365-2648.2006.04038.x
  • Cowan DT, Norman I, Coopamah VP. Competence in nursing practice: a controversial concept–a focused review of literature. Nurse Educ Today. 2005;25:355–62. https://doi.org/10.1016/j.aaen.2006.11.002
  • Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975 Feb 22;1(5955):447-51. https://dx.doi.org/10.1136%2Fbmj.1.5955.447
  • Abdelaziz A, Kassab SE, Abdelnasser A, Hosny S. Medical Education in Egypt: Historical Background, Current Status, and Challenges. Health Prof Educ. 2018;4:236–44. https://doi.org/10.1016/j.hpe.2017.12.007
  • Collins LG, Schrimmer A, Diamond J, Burke J. Evaluating verbal and non-verbal communication skills, in an ethnogeriatric OSCE. Patient Educ Couns. 2011;83:158–62. https://doi.org/10.1016/j.pec.2010.05.012
  • Brown G, Manogue M, Martin M. The validity and reliability of an OSCE in dentistry. Eur J Dent Educ. 1999;3:117–25. https:// doi.org/10.1111/j.1600-0579.1999.tb00077.x
  • Pierre RB, Wierenga A, Barton M, Branday JM, Christie CDC. Student evaluation of an OSCE in paediatrics at the University of the West Indies, Jamaica. BMC Med Educ. 2004;4:22. https://doi.org/10.1186/1472-6920-4-22
  • Abdalla A Saeed, Waleed M Al Suwayh, Amal S. Alomri. Students’ perceptions and attitudes towards Objective Structured Clinical Examination (OSCE) in the College of Medicine, KSAU-HS, King Fahad Medical City, Riyadh, Saudi Arabia. JMSCR. 2016; 04(03): 9741-9747. http://dx.doi.org/10.18535/jmscr/v4i3.29
  • Idris SA, Hamza AA, Elhaj MAB, Elsiddig KE, Hafiz MM, Adam ME. Students’ perception of surgical objective structured clinical examination (OSCE) at final year MBBS, University of Khartoum, Sudan. Med J. 2014;1:17–20.
  • Jabeen N, Ehsan H , Mahmood M. Students’ Perception Regarding Objective Structured Clinical Examination (OSCE). J Islamabad Med Dent College. 2015:4(2):85-87.
  • Elfaki O, Al-Humayed S. Medical Students’ Perception of OSCE at the Department of Internal Medicine, College of Medicine, King Khalid University, Abha, KSA. J Coll Physicians Surg Pak. 2016, Vol. 26 (2): 158-159
  • Khaoua MA. The OSCE in Gynaecology and Obstetrics: About the experience of the Faculty of Medicine of Marrakech. Doctorate Degree Thesis, Faculty of Medicine and Pharmacy of Marrakech, University Qadi AYYAD; 2018. http://wd.fmpm.uca.ma/biblio/theses/annee-htm/FT/2018/these209-18.pdf (last accessed: January 16, 2022).
  • Kalbitz M, Liener U, Kornmann M, Gebhard F, Huber-Lang M. Evaluation of an objective structured clinical examination (OSCE) in surgery and orthopedics by medical students. Unfallchirurg.2010;113:726-730,732-733. https://doi.org/10.1007/s00113-0091690-2
  • Griesser MJ, Beran MC, Flanigan DC, Quackenbush M, Van Hoff C, Bishop JY. Implementation of an objective structured clinical exam (OSCE) into orthopedic surgery residency training. J Surg Educ. 2012;69:180–9. https://doi.org/10.1016/j.jsurg.2011.07.015
  • Marshall G, Jones N. A pilot study into the anxiety induced by various assessment methods. Radiography. 2003;9:185–91. https://doi.org/10.1016/S1078-8174(03)00062-2
  • Brand HS, Schoonheim?Klein M. Is the OSCE more stressful? Examination anxiety and its consequences in different assessment methods in dental education. Eur J Dent Educ. 2009;13:147–53. https://doi.org/10.1111/j.1600-0579.2008.00554.x
  • Khan A, Ayub M, Shah Z. An audit of the medical students’ perceptions regarding objective structured clinical examination. Educ Res Int. 2016;2016:1–4. http://dx.doi.org/10.1155/2016/4806398
  • Omu AE, Al-Azemi MK, Omu FE, Al-Harmi J, Diejomaoh MFE. Attitudes of academic staff and students towards the Objective structured clinical examination (OSCE) in obstetrics and gynaecology. Creat Educ. 2016;7:886. http://dx.doi.org/10.4236/ce.2016.76093
  • Chong L, Taylor S, Haywood M, Adelstein B-A, Shulruf B. The sights and insights of examiners in objective structured clinical examinations. J Educ Eval Health Prof. 2017;14:1–8. https://doi.org/10.3352/jeehp.2017.14.34
  • Gormley G. Summative OSCEs in undergraduate medical education. Ulster Med J 2011;80(3):127-132.
  • Fouad S, Gouda E, Nasser AA, Kamal D. Perception of Students, Staff and Simulated Patients towards Objective Structured Clinical Examination (OSCE). Educ Med J. 2019;11:27–42. http://dx.doi.org/10.21315/eimj2019.11.2.4
  • Aoki M, Ishii S, Usui M, Mizuguchi M, Miyano S. The Slope of the Acromion and Rotator Cuff Impingement. Katakansetsu. 1986;10:168–71. https://doi.org/10.11296/katakansetsu1977.10.2_168
  • Epstein RM. Assessment in medical education. N Engl J Med.2007;356:387–96.
  • Rentschler DD, Eaton J, Cappiello J, McNally SF, McWilliam P. Evaluation of undergraduate students using objective structured clinical evaluation. J Nurs Educ. 2007;46:135–9. https://doi. org/10.3928/01484834-20070301-09
  • El-Nemer A, Kandeel N. Using OSCE as an assessment tool for clinical skills: Nursing students’ feedback. Aust J Basic Appl Sci. 2009;3:2465–72.
  • Taylor CA, Green KE. OSCE feedback: A randomized trial of effectiveness, cost-effectiveness and student satisfaction. Creat Educ. 2013;4:9. http://dx.doi.org/10.4236/ce.2013.46A002
  • Rao VD, Reddy MPK, Reddy MR, Hanumiah A, Sunder PS, Reddy TN, et al. Student evaluation of an OSCE in general medicine at Mamata Medical College, Andhra Pradesh. Int J Med Res Health Sci. 2014; 3:342–5. http://dx.doi.org/10.5958/j.2319-5886.3.2.071
  • Azim Majumder A, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019;10:387–97. https://dx.doi.org/10.2147%2FAMEP.S197275
  • Khan H. OSCEs are outdated: clinical skills assessment should be centred around workplace-based assessments (WPBAs) to put the ‘art’ back into medicine. MedEdPublish. 2017;6:189. https://doi.org/10.15694/mep.2017.000189
  • Abouzeid E & Abdelnasser A. Evaluation of the Portfolio’s Implementation in Clinical Clerkship: Students’ and Staff’s Perception in Egypt. J Med Educ. 2019;17:205–14. https://dx.doi.org/10.22037/jme.v17i4.23742
  • Walsh M, Bailey PH, Koren I. Objective structured clinical evaluation of clinical competence: An integrative review. J Adv Nurs. 2009;65:1584–95. https://doi.org/10.1111/j.1365-2648.2009.05054.x
  • Zayyan M. Objective structured clinical examination: The assessment of choice. Oman Med J. 2011;26:219–22. https://doi.org/10.5001/omj.2011.55

Abstract Views: 355

PDF Views: 112




  • Medical Students’ Perception of a Newly Implemented Objective Structured Clinical Examination (OSCE) in Orthopedic Surgery and Trauma: A Mixed-Method Study

Abstract Views: 355  |  PDF Views: 112

Authors

Asser Sallam
Orthopedic Surgery and Trauma Department, Faculty of Medicine, SUEZ Canal University, Ismailia, Egypt
Hani Atwa
College of Medicine and Medical Sciences, Arabian Gulf University, Manama, Bahrain
Adel Abdelaziz
Medical Education Department, Faculty of Medicine, SUEZ Canal University, Ismailia, Egypt
Asmaa Abdel Nasser
Ibn Sina National College for Medical Studies, Jeddah, Saudi Arabia

Abstract


Introduction: Objective Structured Clinical Examination (OSCE) is a well-known, widespread method of assessment of clinical skills. It is being widely used in Egyptian medical schools. This study aimed to explore the perception of the fifth-year medical students on the attributes, quality, validity, reliability and organization of the end-of-rotation Orthopedics Surgery and Trauma OSCE held at FOM-SCU in two academic years (2017-2018 and 2018-2019). It also aimed to assess the students rating of OSCE in relation to the other available assessment methods in clinical rotations. Material and Methods: This is a cross-sectional mixed-method study that was conducted at Suez Canal University Hospital. A convenient sample of the fifth-year medical students, who underwent the OSCE at the end of their Orthopedic Surgery and Trauma rotation during both academic years 2017-2018 and 2018-2019 were involved (n = 254). Quantitative data were collected through a validated questionnaire consisting of 32 items. Focus group discussions of students were conducted and qualitative data were recorded, coded, and thematically analyzed. Results: More than half of the students (55.5%) believed that the exam was fair and covered a wide range of knowledge (63.8%) and clinical skills (72.4%). Considerable percentages of students were doubtful regarding the standardization of OSCE scores (62.6%) and whether those scores provided a true measurement of their clinical skills (65%) and more than half of them were not sure whether gender, personality, or ethnicity affected their exam scores (55.5%) and whether OSCE provides them practical and useful experience (53.5%). OSCE and portfolio were reported as the easiest method among 55.5% and 63.8% of students, respectively, and 31.1% rated MCQs as the most difficult form of assessment. Qualitative analysis identified two themes; namely: “Challenges of implementing OSCE” and “Ways to overcome identified challenges”. Conclusion: Medical students positively perceived and provided good perception on the organization and implementation of the Orthopedics OSCE, although some of them were doubtful regarding its validity and reliability in assessing their clinical skills in Orthopedics and Trauma. The challenges regarding the OSCE can be overcome by more well-structured, practical training and orientation sessions for the examiners, students, and simulated patients.

Keywords


Clinical Skills Assessment, Competency-Based Education, Orthopedics and Trauma, OSCE; Students’ Perceptions.

References





DOI: https://doi.org/10.18311/jeoh%2F2022%2F29397