Pilot testing of guidelines to support good practice in the development of professional portfolios.

AIMS: The aims of this study were to evaluate whether the introduction of new evidence based portfolio guidelines helped students and assessors to understand the expectations for completion of a clinical practice portfolio, and whether this understanding resulted in the submission of evidence consistent with the guidelines.

METHODS: New evidence based portfolio guidelines were introduced to an undergraduate BSc (Hons) Radiography (Diagnostic) programme. A total of 134 students completed 12 item questionnaires relating to using the portfolio guidelines. Semi-structured interviews were undertaken with 12 students and 5 lecturer practitioners. Documentary analysis was undertaken on 26 portfolios.

RESULTS: Survey data indicated that the new guidelines increased students' understanding of portfolio evidence requirements. Statistically significant increases in scores were evident for only two out of 12 questions; these related to understanding the need for critical reflection and which elements of the portfolio would be rewarded in assessment. Survey data also indicated some dissatisfaction with the role of lecturer practitioners and clinical assessors in relation to portfolio development. Interviews provided more mixed perceptions of the contribution of enhanced guidelines and identified some reasons for dissatisfaction with the lecturer practitioner and clinical assessor role. Documentary analysis indicated that whilst the guidelines improved students' and lecturers' understanding of evidence requirements, this did not translate into portfolio evidence which matched guideline expectations. Portfolio evidence was restricted to meeting the minimum profession specific task requirements and often indicated a mis-match between guideline expectations and assessor assessment judgements.

CONCLUSIONS: New evidence based guidelines improved understanding of evidence and presentation requirements for clinical practice portfolios. Consistent interpretation of portfolio guidelines however requires structured preparation and ongoing support of students, assessors and lecturers if the pedagogic aims for clinical portfolio use are to become an integral part of providing evidence of meeting professional competence requirements.