Development and validation of a performance-based palliative care assessment tool for student pharmacists

Integration of hospice and palliative care principles within pharmacy curricula is essential to fill the need of pharmacist training in this growing specialty. A formalized assessment tool to evaluate skill development does not exist for student pharmacists specific to palliative care. The objective of this study was to develop a valid and reliable, palliative care-focused, performance-based assessment tool for student pharmacists. Eight academic palliative care (PC) pharmacists were recruited for the workgroup to perform domain development, validation, tool creation, and reliability testing for this performance-based assessment tool. Hospice and palliative care clinical pharmacist entrustable professional activities (EPAs) served as the framework. Content validity testing utilized content validity index and scale universal agreement (S-CVI/UA) to determine level of agreement for activities included in the tool. Student volunteers completed a standardized patient case and workgroup members served as raters during the reliability testing phase. Interrater reliability was measured through calculation of Fleiss Kappa scores for each activity. Out of 14 EPAs, nine were deemed “essential” to include in the tool. Thirty-four supporting activities for the nine essential EPAs were drafted. Two rounds of content validity testing were necessary to achieve S-CVI/UA of 0.9593. Consensus was reached from workgroup members for activities deemed necessary to include in the tool after questionnaire distribution utilizing a Fleiss Kappa cutoff >0.6. This validated tool will afford colleges and schools of pharmacy with PC curricula an opportunity to assess student achievement of PC-specific skills and evaluate curricular effectiveness.