Add like
Add dislike
Add to saved papers

Establishing a training plan and estimating inter-rater reliability across the multi-site Texas childhood trauma research network.

Psychiatry Research 2023 March 13
OBJECTIVE: Minimal guidance is available in the literature to develop protocols for training non-clinician raters to administer semi-structured psychiatric interviews in large, multi-site studies. Previous work has not produced standardized methods for maintaining rater quality control or estimating interrater reliability (IRR) in such studies. Our objective is to describe the multi-site Texas Childhood Trauma Research Network (TX-CTRN) rater training protocol and activities used to maintain rater calibration and evaluate protocol effectiveness.

METHODS: Rater training utilized synchronous and asynchronous didactic learning modules, and certification involved critique of videotaped mock scale administration. Certified raters attended monthly review meetings and completed ongoing scoring exercises for quality assurance purposes. Training protocol effectiveness was evaluated using individual measure and pooled estimated IRRs for three key study measures (TESI-C, CAPS-CA-5, MINI-KID [Major Depressive Episodes - MDE & Posttraumatic Stress Disorder - PTSD modules]). A random selection of video-recorded administrations of these measures was evaluated by three certified raters to estimate agreement statistics, with jackknife (on the videos) used for confidence interval estimation. Kappa, weighted kappa and intraclass correlations were calculated for study measure ratings.

RESULTS: IRR agreement across all measures was strong (TESI-C median kappa 0.79, lower 95% CB 0.66; CAPS-CA-5 median weighted kappa 0.71 (0.62), MINI-MDE median kappa 0.71 (0.62), MINI-PTSD median kappa 0.91 (0.9). The combined estimated ICC was ≥0.86 (lower CBs ≥0.69).

CONCLUSIONS: The protocol developed by TX-CTRN may serve as a model for other multi-site studies that require comprehensive non-clinician rater training, quality assurance guidelines, and a system for assessing and estimating IRR.

Full text links

For the best experience, use the Read mobile app

Group 7SearchHeart failure treatmentPapersTopicsCollectionsEffects of Sodium-Glucose Cotransporter 2 Inhibitors for the Treatment of Patients With Heart Failure Importance: Only 1 class of glucose-lowering agents-sodium-glucose cotransporter 2 (SGLT2) inhibitors-has been reported to decrease the risk of cardiovascular events primarily by reducingSeptember 1, 2017: JAMA CardiologyAssociations of albuminuria in patients with chronic heart failure: findings in the ALiskiren Observation of heart Failure Treatment study.CONCLUSIONS: Increased UACR is common in patients with heart failure, including non-diabetics. Urinary albumin creatininineJul, 2011: European Journal of Heart FailureRandomized Controlled TrialEffects of Liraglutide on Clinical Stability Among Patients With Advanced Heart Failure and Reduced Ejection Fraction: A Randomized Clinical Trial.Review

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app

Read by QxMD is copyright © 2021 QxMD Software Inc. All rights reserved. By using this service, you agree to our terms of use and privacy policy.

You can now claim free CME credits for this literature searchClaim now

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app