We have located links that may give you full text access.
Psychiatry Clinical Skills Evaluation: Interrater Reliability of the American Board of Psychiatry and Neurology Required Assessment.
Academic Psychiatry 2021 August
OBJECTIVE: The American Board of Psychiatry and Neurology (ABPN) requires applicants to successfully complete at least 3 Clinical Skills Evaluations (CSE) as part of the credentialing requirements to sit for the psychiatry certification examination. The authors examined a database of CSE assessments conducted at a single site to determine the interrater and test-retest reliability of the evaluation.
METHODS: The authors examined 159 CSE assessments of 51 practicing psychiatrists who completed residency prior to the implementation of CSEs, but did not previously sit for the ABPN examination and later required CSEs to do so. Of these, 36 were simultaneously observed by 2 evaluators, at least 1 of whom had extensive experience with the CSE and 8 of whom were novice evaluators. At least 3 CSEs were done on the same day by each candidate.
RESULTS: The intraclass correlations for CSEs observed by 2 evaluators for the 3 clinical skills assessed (patient-physician relationship, conduct of the interview, and case presentation), were in the low-moderate "good" range for interrater reliability. Test-retest reliability for all candidates was in the moderate-high "good" range. Significant learning took place between the 1st and 3rd CSEs, with a mean improvement of 0.42-0.49 points on an 8-point scale (p < 0.01).
CONCLUSIONS: These data demonstrate good interrater reliability for the CSE even when conducted by novice faculty evaluators and good test-retest reliability despite significant learning that occurred over the series of assessments. The study supports both the educational and assessment value of the CSE.
METHODS: The authors examined 159 CSE assessments of 51 practicing psychiatrists who completed residency prior to the implementation of CSEs, but did not previously sit for the ABPN examination and later required CSEs to do so. Of these, 36 were simultaneously observed by 2 evaluators, at least 1 of whom had extensive experience with the CSE and 8 of whom were novice evaluators. At least 3 CSEs were done on the same day by each candidate.
RESULTS: The intraclass correlations for CSEs observed by 2 evaluators for the 3 clinical skills assessed (patient-physician relationship, conduct of the interview, and case presentation), were in the low-moderate "good" range for interrater reliability. Test-retest reliability for all candidates was in the moderate-high "good" range. Significant learning took place between the 1st and 3rd CSEs, with a mean improvement of 0.42-0.49 points on an 8-point scale (p < 0.01).
CONCLUSIONS: These data demonstrate good interrater reliability for the CSE even when conducted by novice faculty evaluators and good test-retest reliability despite significant learning that occurred over the series of assessments. The study supports both the educational and assessment value of the CSE.
Full text links
Related Resources
Trending Papers
Challenges in Septic Shock: From New Hemodynamics to Blood Purification Therapies.Journal of Personalized Medicine 2024 Februrary 4
Molecular Targets of Novel Therapeutics for Diabetic Kidney Disease: A New Era of Nephroprotection.International Journal of Molecular Sciences 2024 April 4
The 'Ten Commandments' for the 2023 European Society of Cardiology guidelines for the management of endocarditis.European Heart Journal 2024 April 18
A Guide to the Use of Vasopressors and Inotropes for Patients in Shock.Journal of Intensive Care Medicine 2024 April 14
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app