THE FACILITATOR TOOLBOX: A CHECKLIST TO MEASURE FACILITATION SKILLS AND BEHAVIORS IN THE CONTEXT OF CASE-BASED COLLABORATIVE LEARNING

Abstract

Introduction: Active learning environments such as Case-Based Collaborative Learning (CBCL) utilize flipped-classroom structures to promote inductive reasoning and the application of knowledge to clinical cases in undergraduate medical education. However, the specific facilitation skills needed to shape significant learning experiences during large-group discussions in this context remain underexplored. This study examined how expert facilitators guide CBCL large-group discussions to promote collaborative reasoning and higher-order thinking, and used these findings to develop and validate a practical behavioral observation instrument: the Facilitator Toolbox. Methods: A sequential, mixed-methods design was employed following a modified version of the seven-step framework recommended for instrument development. The phases included: (1) a literature review; (2) qualitative descriptive analysis of 12 video-recorded CBCL sessions led by expert facilitators at Harvard Medical School; (3) synthesis of findings; (4) operationalization of behaviors into binary checklist items; (5) an expert focus group to establish content validity; (6) cognitive interviews to ensure item clarity; and (7) an inter-rater reliability analysis using Cohen's kappa. Results: The seven-phase process yielded the Facilitator Toolbox, a 29-item behavioral observation checklist organized across four facilitation stages: (1) Explore: eliciting and actively listening to students’ initial ideas; (2) Probe: using targeted questioning to surface reasoning and misconceptions; (3) Explain: scaffolding conceptual integration and linking ideas across learners; and (4) Close: consolidating key take-home points; and six behavioral domains: Session Management, Inclusive Teaching, Integration of Knowledge, Productive Struggle, Teaching Modalities, and Reflective Practice. Expert focus group review confirmed content validity and refined instrument structure, while cognitive interviews reduced the item pool from 33 to 29. Inter-rater reliability analysis demonstrated substantial agreement between two independent raters (Cohen's κ = 0.61, p .001). Discussion: Expert CBCL facilitation is characterized by the fluid orchestration of multiple competencies that externalize student reasoning, foster psychological safety, and sustain productive struggle toward conceptual mastery. The four-stage model within the Facilitator Toolbox offers a concrete, evidence-informed framework to guide faculty development, support peer and self-observation, and improve the quality of facilitation in undergraduate medical education.