A SIMPL application to assess oral medicine residents' performance and level of autonomy

Publication date: Available online 29 May 2018
Source:Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology
Author(s): Revathi Shekar, Brian C. George, Jordan D. Bohnen, Alessandro Villa
ObjectivesTo evaluate a smartphone application, SIMPL, to optimize faculty guidance and oral medicine residents' performance, and measure resident-faculty agreement for performance and supervision levels.Study DesignRaters used the 5-level "Performance" scale to assess resident's readiness for independent practice and 4-level Zwisch scale to assess faculty guidance, between June 2016 and June 2017. Junior residents were trainees with less than 18 months of training and senior residents had more than 18 months of training. Descriptive statistics were used to analyze supervision and autonomy. Performance and supervision agreement was estimated as percentage-agreement and measured using Kappa and 95% confidence intervals.ResultsA total of 660 evaluations were performed by six residents and six faculty members. Senior residents received higher performance scores compared to junior residents (p for trend < 0.01). In terms of complexity of cases and level of supervision, there were no significant differences between juniors and seniors (p=0.69 and p=0.39, respectively). Residents were "Practice Ready" or above for 80.0% cases. Residents received meaningful autonomy for 64.8% cases. Faculty-resident concordance was 86.1% for performance (with kappa of 0.77 [95%CI 66.1% to 87.6%]) and 92.4% for supervision (with kappa of 0.84 [95%CI 80% to 88]).ConclusionSIMPL can feasibly be used for real-time assessment of residents' performance and autonomy.



https://ift.tt/2Jgorb7