Assessment of ophthalmology resident on-call performance

Document Type

Article

Abstract

PURPOSE: To design and implement a valid tool for assessment of ophthalmology resident on-call performance. DESIGN: Retrospective chart audit. SETTING: Tertiary care academic ophthalmology programs. PARTICIPANTS: Ophthalmology faculty and residents at the University of Cincinnati and the University of Iowa. METHODS: A 1-page on-call assessment tool (OCAT) and scoring rubric were developed to evaluate ophthalmology resident on-call performance. A retrospective chart audit of consecutive resident on-call charts was performed at the University of Cincinnati and the University of Iowa, and resident performance was scored using the OCAT. RESULTS: A consensus of faculty comments established the face and content validity of the OCAT. One hundred ninety-one on-call consultations were assessed. Timeliness of consultation was the most common category receiving a borderline or unsatisfactory rating. Borderline ratings in knowledge-based categories (history, examination, assessment and plan, urgency rating) occurred more often for postgraduate year 2 (PGY2) residents than for PGY3 residents (P = 0.05, chi-square test). Incomplete differential diagnosis (n = 6) and lack of follow-up instruction (n = 5) were the most common deficiencies observed. CONCLUSIONS: The OCAT has face, content, and discriminative validity. It can be used to assess resident competence in patient care, professionalism, and medical knowledge. Interrater and intrarater reliability still need to be determined. The OCAT may prove to be an additional assessment tool for meeting the Accreditation Council for Graduate Medical Education competencies mandate.

Medical Subject Headings

Clinical Competence; Education, Medical, Graduate (standards); Educational Measurement (methods); Humans; Internship and Residency; Ophthalmology (education); Quality of Health Care; Referral and Consultation; Reproducibility of Results; Retrospective Studies; United States

Publication Date

7-1-2005

Publication Title

Ophthalmology

E-ISSN

1549-4713

Volume

112

Issue

7

First Page

1242

Last Page

6

PubMed ID

15921753

Digital Object Identifier (DOI)

10.1016/j.ophtha.2005.01.032

Link to Full Text

Share

COinS