Skip to main content

Development and evaluation of an endoscopic surgery course for medical students

Cecilia Nilsson1, Flemming Bjerrum2, Morten Stadeager3, Bent Ottesen1 & Jette Led Sorensen1

31. maj 2017
14 min.

Fakta

Fakta

During the past decades, surgical training has undergone major changes with the introduction of endoscopy surgery. Although many surgical procedures today are

performed using endoscopic surgery, a gap in medical schools’ curricula seems evident regarding the theoretical principles of and basic skills training in endoscopic surgery. Research into the role of simulation in surgical skills training has increased dramatically, and the benefits are well established [1, 2].

The current curriculum [3] at the University of Copenhagen, Denmark, includes some basic skills training in open surgery. However, endoscopic surgery, i.e. laparoscopy, requires specific skills which are not included in the current curriculum for medical students [4]. The curriculum includes a mandatory surgical clerkship in which the medical students might be required to assist during laparoscopic surgery. It was shown that when medical students received training in basic surgical skills before assisting in surgery, they achieved greater benefits from the clerkship, showed a higher level of confidence and comfort [5], and improved their knowledge and technical skill [5, 6]. Additionally, the surgical clerkship is valuable in regard to choosing a future career in a surgical specialisation [7]. A pre-graduate course in the theoretical principles of and basic skills training in endoscopic surgery can inform the students’ career choice by making it clear if a career in surgery is aligned with their interests. Additionally, it can prepare students for future surgical training, ease their transition into clinical work and link pre- and postgraduate surgical skills training.

When developing a new course, the process of curriculum development can be challenging. Kern et al [8] proposed a six-step approach to curriculum development, which is a well-established model that aims to support medical educators and is applicable as a general approach in curriculum development.

The objective of this study was to describe the development and evaluation of a pilot course in the theoretical principles of and basic skills training in endoscopic surgery for medical students based on Kern’s six-step approach.

METHODS

Curriculum development

The course was developed from September to November 2015 and was completed and evaluated in November 2015. Anchored in current curriculum development literature, Kern’s six-step approach was used [8] (Table 1).

To cover the theoretical principles of and basic skills training in endoscopic surgery, the course included a cognitive component and a psychomotor component.

To ensure correct terminology when preparing the goals and objectives, Bloom’s taxonomy was used [9]. The multiple choice questioner (MCQ) test was developed according to the principles of the National Board of Medical Examiners [10].

The project group and course faculty

The project group consisted of the primary author and three researchers in assessment and medical education with previous experience in endoscopic surgery. The course faculty consisted of experienced medical doctors in general surgery, gynaecology, urology and respiratory medicine. In collaboration with the course faculty, the project group developed the curriculum, including the goals and objectives and the items of the test.

The course

The cognitive component comprised faculty-led, interactive didactic sessions distributed over three days (a total of 14 hours). The overall goal of the cognitive component was to provide the participants with an overall introduction to the theoretical principles of endoscopic surgery. In this course, endoscopic surgery covered laparoscopy, colonoscopy, gastroscopy, bronchoscopy and cystoscopy. The following sub-topics were included: general introduction and principles of endoscopic surgery (incl. advantages and drawbacks, and pre- and post-operative care), endoscopic equipment (incl. function and handling), pneumoperitoneum, role of the personnel in the operation theatre, common endoscopic procedures (incl. techniques and complication management) and robot-assisted surgery. The psychomotor component included endoscopic simulation training distributed over four sessions (a total of nine hours). The overall goal was to introduce the participants to different types of basic endoscopic simulation training. The simulation training included basic tasks on virtual reality simulators, laparoscopic box-trainers, a robot-assisted laparoscopic surgery simulator and a video-bronchoscopy simulator. On the laparoscopic simulators, the tasks included: grasping, cutting, clip-applying, suturing, camera navigation and a procedure (salpingectomy). On the bronchoscopy simulator, the tasks included anatomy identification. Three medical students assisted the participants during the simulation training; including introduction of the simulators and the basic surgical tasks, and provided feedback on request.

Study participants

The participants were recruited through the student newspaper and student associations for general surgery and gynaecology. The invitation included participation in two projects; 1) a randomised controlled trial [11], studying simulation-based training in camera navigation and transfer of skills to the operating room, followed by 2) participation in a course in endoscopic surgery. The inclusion criteria were: 1) medical student in the fourth, fifth or sixth semester, enrolled at the Faculty of Health Sciences at the University of Copenhagen, 2) informed consent for the trial. The exclusion criteria were: 1) previous participation in projects involving laparoscopic training, 2) experience with laparoscopic surgery (> 0 procedures), and 3) lack of ability to lead a conversation in Danish.

Setting and simulators

The training was imparted at Copenhagen Academy for Medical Education and Simulation, Rigshospitalet, Copenhagen, Denmark and The Juliane Marie Centre for Children, Women and Reproduction, Rigshospitalet, Copenhagen, Denmark. The simulators used were: Laparoscopic box-trainers, virtual reality simulators (LapSim, Surgical Science, Sweden), a video-bronchoscopy model (AirSim Advance, TruCorp, Ireland) and da Vinci equipment for robot-assisted surgery (da Vinci, Intuitive Surgical, USA).

Assessment

A 35-item test was developed based on the general goals and objectives. The course faculty prepared relevant items in their respective areas of expertise, which were reviewed by the project group. All items included four alternatives, based on the one-best-answer principle [10]. The maximum score was 35. The same test was administered before and after the course.

Evaluation

The items in the evaluation questionnaire were developed by the project group and focused on the contents, structure and relevance of the course, and on the student’s future interest in a surgical career. The evaluation included 13 questions of which two were open-ended and 11 questions were evaluated on a five-point Likert scale (Table 2).

The two open-ended questions included considerations about future specialisation and whether the course had an impact on their considerations concerning a future career. To optimise the response rate, one electronic reminder was sent out.

Statistics

Data were analysed using SPSS version 22.0 (IBM, Armonk, New York, USA). The mean difference of the pre- and post-test score was analysed using paired Student’s t-test. A two-sided significance level of p < 0.05 was used.

Ethics

Participation in the course was voluntary, and participants could withdraw at any given point. All results of the test and evaluation were handled anonymously and could in no way influence the students’ future career. No ethical approval was necessary for the present study according to Danish provisions.

Trial registration: not relevant.

RESULTS

Of the 34 included medical students, a total of 26 (mean age 22 years, 53% females) agreed to participate in the course and 23 completed the full course. The three dropouts were due to private reasons.

A significant difference between the pre- and post-test score was found, p < 0.0001, with a mean score of 14.3 (95% confidence interval (CI): 12.9-15.7) on the pre-test and 27.2 (95% CI: 25.7-28.7) on the post-test; the mean difference was 13.0 (95% CI: 11.5-14.4).

A total of 19 students completed the online evaluation. Overall, the evaluation was very positive, both regarding course contents, structure and relevance (Table 2). The two open questions, 74% (14/19) noted that the course had increased their interest in a career in one of the surgical specialisations or supported their previous considerations with respect to a career in surgery, 21% (4/19) reported that the course had not affected their considerations about their future career, and 5% (1/19) did not know if the course had affected their thoughts about their future career. Regarding considerations on future specialisation, 58% (11/19) were considering specialising in surgery, 21% (4/19) considered other areas than surgery and 21% (4/19) had not yet considered specialisation.

DISCUSSION

Overall, the students perceived the course positively regarding contents, structure and relevance. The evaluation suggested that the course was both relevant, a good supplement to the current curriculum for medical students and useful as guidance for their future career. Three quarters of the students implied that the course had confirmed or increased their interest in surgery, and more than half of the students were strongly considering a career in surgery.

The course was developed using the well-established Kern’s six-step approach to ensure a structured development process [8]. Based on the gap in the present surgical curriculum, we developed goals and objectives covering the theoretical principles of and basic skills training in endoscopic surgery. We used didactic sessions in combination with simulation-based skills training as educational methods and experienced teachers were in charge of their respective area of expertise. The subjects included in the didactic sessions as well as the skills training were based on the developed goals and objectives, and the students’ knowledge was tested using a 35-item test based on the goals and objectives. The course was evaluated as a whole using an evaluation questionnaire.

The limitation of the evaluation questionnaire lies in the potential risk of selection bias and the use of a non-validated evaluation questionnaire. Participation was voluntary and participants were recruited mainly from student organisations with an interest in surgery; and they could therefore potentially represent a highly motivated group. Optimally, the evaluation questionnaire should have been validated and suggestively expanded, regarding course contents and structure, to

further learn from the students’ experiences with the course. Another interesting area to further examine is the course’s potential impact on career choice. In the present study, this was only briefly included, but students implied that the course had a positive impact on their present considerations about the surgical specialisations.

The students reported positive experiences with the simulation-based skills training, but some requested more time for practice. Unfortunately, due to resource and time restrictions, the skills training offered in our course was time-limited and structured only to give the students a chance to try different aspects of simulation-based skills training. Ideally, the skills training should be practiced in a deliberate, proficiency-based manner and distributed over time [12, 13].

Regarding the assessment, both technical skills and knowledge should have been tested using validated methods, and transfer of skills should have been evaluated. In this course, a non-validated knowledge test was used. Ideally, the MCQ test should have been validated [14] as this is an effective tool for cognitive assessment. Nevertheless, test development is a complex and time-consuming process, and such development was therefore omitted due to time and resource restrictions.

Implementation of a course in endoscopic surgery can bridge the gap in the present surgical curriculum, and is suggested to help cultivate the medical students’ surgical interest and to enhance experience and learning during the clerkship. A down-scaled version of the course could be integrated in the current curriculum and offered to all medical students; or the full version could be offered as an option to students with a special interest in the surgical specialisations. It was demonstrated that participation in surgical skills courses increases the likelihood of a subsequent career within a surgical specialisation [7, 15]. The course is both preparatory for a future career in surgery, but could also act as guidance and a tool for medical students helping them choose their specialisation. Since participation in a surgical skills course before onset of specialist training improves knowledge and technical skills [5, 6, 16], the trainee might already have acquired the basic surgical techniques and hereby have improved the educational efficiency during specialist training [17], and this might ease the transition into a surgical specialisation. The timing

of the course is suggested to be close to graduation to minimise any decay of skills [5, 18]. Medical schools are encouraged to implement a course in endoscopic surgery to link, support and improve the pre- and postgraduate training of future surgeons.

CONCLUSIONS

We developed a pilot course in endoscopic surgery that was overall perceived positively by the students both for its contents, structure and relevance. Implementation of a course in endoscopic surgery for medical students is proposed with a view of linking the pre- and postgraduate education of future surgeons.

Correspondence: Cecilia Nilsson. E-mail: cecnilsson@gmail.com

Accepted: 28 March 2017

Conflicts of interest: none. Disclosure forms provided by the authors are available with the full text of this article at www.danmedj.dk

Acknowledgements: We would like to thank the three medical students who kindly assisted us during the skills training: Diana Haunstrup Bregner Overgaard, Katrine Jeong Jørgensen, Christina Maria Schiøttz Hassing. We would also like to express our gratitude to Leizl Joy Nayahangan for assistance with overall coordination at CAMES. Additionally, we are indebted to the teachers; Mikkel Westen, Sarah Bubbe, Torur Dalsgaard, Maria Havemann and Paul Frost Clementsen. We also would like to extend our gratitude to professor Lars Konge at CAMES for valuable input and support and, finally, we are grateful for the participation of all the medical students who took the course.  

Referencer

LITERATURE

  1. Zendejas B, Brydges R, Hamstra SJ et al. State of the evidence on simulation-based training for laparoscopic surgery: a systematic review. Ann Surg 2013;257:586-93.

  2. Larsen CR, Oestergaard J, Ottesen BS et al. The efficacy of virtual reality simulation training in laparoscopy: a systematic review of randomized trials. Acta Obstet Gynecol Scand 2012;91:1015-28.

  3. Målbeskrivelse for kandidatdelen for medicinstudiet. University of Copenhagen, 2015. http://studier.ku.dk/kandidat/medicin/undervisning-og-opbygning/.

  4. Figert PL, Park AE, Witzke DB et al. Transfer of training in acquiring laparoscopic skills. J Am Coll Surg 2001;193:533-7.

  5. Supe A, Prabhu R, Harris I et al. Structured training on box trainers for first year surgical residents: does it improve retention of laparoscopic skills? A randomized controlled study. J Surg Educ 2012;69:624-32.

  6. Gawad N, Zevin B, Bonrath EM et al. Introduction of a comprehensive training curriculum in laparoscopic surgery for medical students: a randomized trial. Surgery 2014;156:698-706.

  7. Goldin SB, Schnaus MJ, Horn G et al. Surgical interest and surgical match for third-year students: results of a prospective multivariate longitudinal cohort study. J Am Coll Surg 2012;215:599-606.

  8. Kern DE TP, Hughes MT Curriculum development for medical education: a six-step approach. 2nd ed. Baltimore: Johns Hopkins University Press, 2009.

  9. Bloom BS. Taxonomy of educational objectives: a classification of educational objectives. New York: Longman, 1984.

  10. Constructing written test questions for the basic and clinical sciences. 3rd ed. National Board of Medical Examiners, 2002.

  11. Nilsson C, Sorensen JL, Konge L et al. Simulation-based camera navigation training in laparoscopy-a randomized trial. Surg Endosc 2016 Oct 21 (e-pub ahead of print).

  12. McGaghie WC, Issenberg SB, Cohen ER et al. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011;86:706-11.

  13. Cook DA, Hamstra SJ, Brydges R et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach 2013;35:e867-e898.

  14. Sorensen JL, Thellesen L, Strandbygaard J et al. Development of knowledge tests for multi-disciplinary emergency training: a review and an example. Acta Anaesthesiol Scand 2015;59:123-33.

  15. Lee JT, Son JH, Chandra V et al. Long-term impact of a preclinical endovascular skills course on medical student career choices. J Vasc Surg 2011;54:1193-200.

  16. Edelman DA, Mattos MA, Bouwman DL. Value of fundamentals of laparoscopic surgery training in a fourth-year medical school advanced surgical skills elective. J Surg Res 2012;177:207-10.

  17. Association of Program Directors in Surgery, American Board of Surgery, American College of Surgeons, Association for Surgical Education. Statement on surgical preresidency preparatory courses. Ann Surg 2014;260:969-70.

  18. Maagaard M, Sorensen JL, Oestergaard J et al. Retention of laparoscopic procedural skills acquired on a virtual-reality surgical trainer. Surg Endosc 2011;25:722-7.