We have located links that may give you full text access.
Early Findings and Strategies for Successful Implementation of SIMPL Workplace-based Assessments within Vascular Surgery Residency and Fellowship Programs.
Journal of Vascular Surgery 2023 May 9
INTRODUCTION: As medical education systems increasingly move toward competency-based training, it is important to understand the tools available to assess competency and how these tools are utilized. The Society for Improving Medical Professional Learning (SIMPL) offers a smart phone-based assessment system that supports workplace-based assessment of residents' and fellows' operative autonomy, performance, and case complexity. The purpose of this study was to characterize implementation of the SIMPL app within vascular surgery integrated residency (0+5) and fellowship (5+2) training programs.
METHODS: SIMPL operative ratings recorded between 2018-2022 were collected from all participating vascular surgery training institutions (n=9 institutions with 5+2 and 0+5 programs, n=4 institutions with 5+2 program only). The characteristics of programs, trainees, faculty, and SIMPL operative assessments were evaluated using descriptive statistics.
RESULTS: Operative assessments were completed for 2,457 cases by 85 attendings and 86 trainees totaling 4,615 unique operative assessment ratings. Attendings included dictated feedback in 52% of assessments. Senior-level residents received more assessments than junior-level residents (PGY 1-3 n=439, PGY4-5 n=551). Performance ratings demonstrated increases from junior to senior trainees for both resident and fellow cohorts with "performance ready" or "exceptional performance" ratings increasing by nearly 2-fold for PGY1 to PGY5 residents (28.1% vs 40.6%), and from first to second year fellows (PGY 6 46.7%, PGY 7 60.3%). Similar gains in autonomy were demonstrated as trainees progressed through training. Senior residents were more frequently granted autonomy with "supervision only" than junior residents (PGY1 8.7%, PGY5 21.6). "Supervision only" autonomy ratings were granted to 21.8% of graduating fellows. Assessment data included a greater proportion of complex cases for senior compared to junior fellows (PGY6 20.9% vs PGY 7 26.5%). Program Directors felt that faculty and trainee buy-in were the main barriers to implementation of the SIMPL assessment app.
CONCLUSIONS: This is the first description of the SIMPL app as an operative assessment tool within vascular surgery which has been successfully implemented in both residency and fellowship programs. The assessment data demonstrates expected progressive gains in trainees' autonomy and performance, as well as increasing case complexity, across PGY years. Given the selection of SIMPL as the assessment platform for required American Board of Surgery and Vascular Surgery Board EPA assessments, understanding facilitators and barriers to implementation of workplace-based assessments using this app is imperative, particularly as we move toward competency-based medical education.
METHODS: SIMPL operative ratings recorded between 2018-2022 were collected from all participating vascular surgery training institutions (n=9 institutions with 5+2 and 0+5 programs, n=4 institutions with 5+2 program only). The characteristics of programs, trainees, faculty, and SIMPL operative assessments were evaluated using descriptive statistics.
RESULTS: Operative assessments were completed for 2,457 cases by 85 attendings and 86 trainees totaling 4,615 unique operative assessment ratings. Attendings included dictated feedback in 52% of assessments. Senior-level residents received more assessments than junior-level residents (PGY 1-3 n=439, PGY4-5 n=551). Performance ratings demonstrated increases from junior to senior trainees for both resident and fellow cohorts with "performance ready" or "exceptional performance" ratings increasing by nearly 2-fold for PGY1 to PGY5 residents (28.1% vs 40.6%), and from first to second year fellows (PGY 6 46.7%, PGY 7 60.3%). Similar gains in autonomy were demonstrated as trainees progressed through training. Senior residents were more frequently granted autonomy with "supervision only" than junior residents (PGY1 8.7%, PGY5 21.6). "Supervision only" autonomy ratings were granted to 21.8% of graduating fellows. Assessment data included a greater proportion of complex cases for senior compared to junior fellows (PGY6 20.9% vs PGY 7 26.5%). Program Directors felt that faculty and trainee buy-in were the main barriers to implementation of the SIMPL assessment app.
CONCLUSIONS: This is the first description of the SIMPL app as an operative assessment tool within vascular surgery which has been successfully implemented in both residency and fellowship programs. The assessment data demonstrates expected progressive gains in trainees' autonomy and performance, as well as increasing case complexity, across PGY years. Given the selection of SIMPL as the assessment platform for required American Board of Surgery and Vascular Surgery Board EPA assessments, understanding facilitators and barriers to implementation of workplace-based assessments using this app is imperative, particularly as we move toward competency-based medical education.
Full text links
Related Resources
Trending Papers
Challenges in Septic Shock: From New Hemodynamics to Blood Purification Therapies.Journal of Personalized Medicine 2024 Februrary 4
Molecular Targets of Novel Therapeutics for Diabetic Kidney Disease: A New Era of Nephroprotection.International Journal of Molecular Sciences 2024 April 4
Perioperative echocardiographic strain analysis: what anesthesiologists should know.Canadian Journal of Anaesthesia 2024 April 11
The 'Ten Commandments' for the 2023 European Society of Cardiology guidelines for the management of endocarditis.European Heart Journal 2024 April 18
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app