We have located links that may give you full text access.
Evaluation Studies
Journal Article
Research Support, Non-U.S. Gov't
Treatment fidelity instrument to measure a brief opportunistic intervention for prenatal substance use.
OBJECTIVE: To develop and psychometrically evaluate an instrument designed to measure the treatment fidelity associated with implementation of the I Am Concerned (IAC) brief opportunistic intervention by frontline, prenatal, primary care staff.
DESIGN: A methodologic approach framed development of the IAC Treatment Fidelity Instrument in a six-phase protocol.
SETTING: A simulated prenatal clinic with standardized patients portraying substance-using pregnant women.
PARTICIPANTS: Prenatal, primary care, frontline staff (N = 6), experienced in IAC implementation.
METHODS: Following development of the IAC treatment fidelity instrument, independent raters used the instrument to evaluate audio recordings (N = 49) of frontline staff implementing the IAC brief opportunistic intervention with standardized patients representing substance-using pregnant women.
RESULTS: Psychometric analysis provided evidence of content validity. Intraclass correlation coefficients calculated for inter-rater reliability were satisfactory for subscales (0.64) and (0.62) and ranged from -0.07 to 0.81 for individual items. Internal consistency alpha coefficients were satisfactory for the total scale (0.72) and lower than acceptable for adherence (0.54) and competence (0.56) subscales. Overall high rater percentage agreement and negatively skewed ratings distribution indicated reliability results were paradoxically low due to the base rate problem.
CONCLUSION: Results support revision and ongoing testing of the IAC treatment fidelity instrument. The impact on reliability statistics exerted by this study's skewed data distribution has implications for nursing research as low variance can be anticipated when measuring care provided to homogenous patient populations. It is important to recognize the resulting influence on inter-rater agreement to avoid making inaccurate interpretations about the reliability of an instrument's measurements.
DESIGN: A methodologic approach framed development of the IAC Treatment Fidelity Instrument in a six-phase protocol.
SETTING: A simulated prenatal clinic with standardized patients portraying substance-using pregnant women.
PARTICIPANTS: Prenatal, primary care, frontline staff (N = 6), experienced in IAC implementation.
METHODS: Following development of the IAC treatment fidelity instrument, independent raters used the instrument to evaluate audio recordings (N = 49) of frontline staff implementing the IAC brief opportunistic intervention with standardized patients representing substance-using pregnant women.
RESULTS: Psychometric analysis provided evidence of content validity. Intraclass correlation coefficients calculated for inter-rater reliability were satisfactory for subscales (0.64) and (0.62) and ranged from -0.07 to 0.81 for individual items. Internal consistency alpha coefficients were satisfactory for the total scale (0.72) and lower than acceptable for adherence (0.54) and competence (0.56) subscales. Overall high rater percentage agreement and negatively skewed ratings distribution indicated reliability results were paradoxically low due to the base rate problem.
CONCLUSION: Results support revision and ongoing testing of the IAC treatment fidelity instrument. The impact on reliability statistics exerted by this study's skewed data distribution has implications for nursing research as low variance can be anticipated when measuring care provided to homogenous patient populations. It is important to recognize the resulting influence on inter-rater agreement to avoid making inaccurate interpretations about the reliability of an instrument's measurements.
Full text links
Related Resources
Trending Papers
Challenges in Septic Shock: From New Hemodynamics to Blood Purification Therapies.Journal of Personalized Medicine 2024 Februrary 4
Molecular Targets of Novel Therapeutics for Diabetic Kidney Disease: A New Era of Nephroprotection.International Journal of Molecular Sciences 2024 April 4
The 'Ten Commandments' for the 2023 European Society of Cardiology guidelines for the management of endocarditis.European Heart Journal 2024 April 18
A Guide to the Use of Vasopressors and Inotropes for Patients in Shock.Journal of Intensive Care Medicine 2024 April 14
Diagnosis and Management of Cardiac Sarcoidosis: A Scientific Statement From the American Heart Association.Circulation 2024 April 19
Essential thrombocythaemia: A contemporary approach with new drugs on the horizon.British Journal of Haematology 2024 April 9
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app