Ophthalmic Simulated Surgical Competency Assessment Rubric for manual small-incision cataract surgery

Authors

William H. Dean, International Centre for Eye Health, London School of Hygiene and Topical Medicine, London, England; Imperial College London, London, England. Electronic address: will.dean@lshtm.ac.uk.
Neil L. Murray, Royal Australian and New Zealand College of Ophthalmologists, Sydney, Australia.
John C. Buchan, International Centre for Eye Health, London School of Hygiene and Topical Medicine, London, England.
Karl Golnik, International Council of Ophthalmology, San Francisco, California, USA.
Min J. Kim, Tropical Epidemiology Group, Faculty of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, England.
Matthew J. Burton, International Centre for Eye Health, London School of Hygiene and Topical Medicine, London, England; Moorfields Eye Hospital, London, England.

Document Type

Article

Abstract

PURPOSE: To develop and test the validity of a surgical competency assessment tool for simulated small-incision cataract surgery (SICS). SETTING: Participating ophthalmologists contributed from 8 countries. DESIGN: Qualitative and quantitative development and evaluation of face and content validity of an assessment rubric, and evaluation of construct validity and reliability. METHODS: The SICS Ophthalmic Simulated Surgical Competency Assessment Rubric (Sim-OSSCAR) was developed and assessed for face and content validity by an international group of experienced ophthalmologists. Groups of novice and competent surgeons from 4 countries were recorded performing surgery, and masked assessments were performed by 4 expert surgeons, to determine construct validity and reliability. RESULTS: The Sim-OSSCAR for SICS was assessed by a panel of 12 international experts from 8 countries. In response to the question, "Do you think the OSSCAR represents the surgical techniques and skills upon which trainees should be assessed?," all respondents either agreed or strongly agreed. Face validity was rated as 4.60 (out of 5.0). The content was iteratively agreed to by the panel of experts; final content validity was rated as 4.5. Interobserver reliability was assessed, and 17 of 20 items in the assessment matrix had a Krippendorff α correlation of more than 0.6. A Wilcoxon rank-sum test showed that competent surgeons perform better than novices (P = .02). CONCLUSIONS: This newly developed and validated assessment tool for simulation SICS, based on the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric, has good face and content validity. It can play a role in ophthalmic surgical education.

Medical Subject Headings

Cataract Extraction (education); Clinical Competence (standards); Education, Medical, Graduate (standards); Educational Measurement (standards); Humans; Internship and Residency; Microsurgery; Ophthalmology (education); Reproducibility of Results

Publication Date

9-1-2019

Publication Title

Journal of cataract and refractive surgery

E-ISSN

1873-4502

Volume

45

Issue

9

First Page

1252

Last Page

1257

PubMed ID

31470940

Digital Object Identifier (DOI)

10.1016/j.jcrs.2019.04.010

Recommended Citation

Dean, William H.; Murray, Neil L.; Buchan, John C.; Golnik, Karl; Kim, Min J.; and Burton, Matthew J., "Ophthalmic Simulated Surgical Competency Assessment Rubric for manual small-incision cataract surgery" (2019). Neurology. 1601.
https://scholar.barrowneuro.org/neurology/1601