Using video-cases to assess student reflection: Development and validation of an instrument

Sebastiaan Koole*, Tim Dornan, Leen Aper, Bram De Wever, Albert Scherpbier, Martin Valcke, Janke Cohen-Schotanus, Anselme Derese

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    28 Citations (Scopus)
    296 Downloads (Pure)

    Abstract

    Background: Reflection is a meta-cognitive process, characterized by: 1. Awareness of self and the situation; 2. Critical analysis and understanding of both self and the situation; 3. Development of new perspectives to inform future actions. Assessors can only access reflections indirectly through learners' verbal and/or written expressions. Being privy to the situation that triggered reflection could place reflective materials into context. Video-cases make that possible and, coupled with a scoring rubric, offer a reliable way of assessing reflection.

    Methods: Fourth and fifth year undergraduate medical students were shown two interactive video-cases and asked to reflect on this experience, guided by six standard questions. The quality of students' reflections were scored using a specially developed Student Assessment of Reflection Scoring rubric (StARS (R)). Reflection scores were analyzed concerning interrater reliability and ability to discriminate between students. Further, the intra-rater reliability and case specificity were estimated by means of a generalizability study with rating and case scenario as facets.

    Results: Reflection scores of 270 students ranged widely and interrater reliability was acceptable (Krippendorff's alpha = 0.88). The generalizability study suggested 3 or 4 cases were needed to obtain reliable ratings from 4th year students and >= 6 cases from 5th year students.

    Conclusion: Use of StARS (R) to assess student reflections triggered by standardized video-cases had acceptable discriminative ability and reliability. We offer this practical method for assessing reflection summatively, and providing formative feedback in training situations.

    Original languageEnglish
    Article number22
    Number of pages8
    JournalBMC Medical Education
    Volume12
    DOIs
    Publication statusPublished - 20-Apr-2012

    Keywords

    • MEDICAL COMMUNICATION-SKILLS
    • METACOGNITIVE AWARENESS
    • GENERALIZABILITY
    • RELIABILITY
    • TEACHERS
    • VALIDITY
    • FEEDBACK
    • THINKING
    • RUBRICS
    • LEVEL

    Cite this