Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement?

Adam S Tunis, Matthew D F McInnes, Ramez Hanna, Kaisra Esmail
Radiology 2013, 269 (2): 413-26

PURPOSE: To evaluate whether completeness of reporting of systematic reviews and meta-analyses in major radiology journals has changed since publication of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement; a secondary objective is to evaluate whether completeness of reporting (ie, PRISMA) is associated with study quality (ie, Assessing the Methodological Quality of Systematic Reviews [AMSTAR]).

MATERIALS AND METHODS: Systematic reviews and meta-analyses published in major radiology journals between January 2007 and December 2011 were identified by searching MEDLINE with the modified Montori method. Studies were reviewed independently by two investigators and assessed for adherence to the AMSTAR and PRISMA checklists. The average results were analyzed to assess for change in mean score before and after PRISMA publication and to assess results over time; a Pearson correlation coefficient was calculated to assess for any association between PRISMA and AMSTAR results.

RESULTS: Included were 130 studies from 11 journals. Average PRISMA and AMSTAR results were 21.8 of 27 and 7.2 of 11, respectively. The average result was higher after publication of PRISMA, and PRISMA-reported items were 22.6 of 27 after publication of PRISMA versus 20.9 of 27 before publication of PRISMA; AMSTAR results were 7.7 of 11 after publication of PRISMA versus 6.7 of 11 before publication of PRISMA. There was a strong positive correlation (r = 0.86) between the PRISMA and AMSTAR results. There was high variability between journals. Radiology had the highest PRISMA reported items (24.7 of 27), and American Journal of Neuroradiology had the lowest (19.6 of 27). Two major areas for improvement include study protocol registration and assessment of risk of bias across studies (ie, publication bias).

CONCLUSION: In major radiology journal studies, there was modest improvement in completeness of reporting of systematic reviews and meta-analyses, assessed by PRISMA, which was strongly associated with higher study quality, assessed by AMSTAR.


Full Text Links

Find Full Text Links for this Article


You are not logged in. Sign Up or Log In to join the discussion.

Related Papers

Remove bar
Read by QxMD icon Read

Save your favorite articles in one place with a free QxMD account.


Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"