Validity, Reliability and Acceptability of the Team Standardized Assessment of Clinical Encounter Report*

Authors

  • Camilla L. Wong St. Michael's Hospital
  • Mireille Norris Sunnybrook Health Sciences Centre
  • Samir S. Sinha Mount Sinai Hospital
  • Maria L. Zorzitto St. Michael’s Hospital
  • Sushma Madala The Wright Center for Graduate Medical Education
  • Jemila S. Hamid St. Michael’s Hospital

DOI:

https://doi.org/10.5770/cgj.19.234

Keywords:

communication, collaboration, postgraduate, assessment, feedback

Abstract

Background

The Team Standardized Assessment of a Clinical Encounter Report (StACER) was designed for use in Geriatric Medicine residency programs to evaluate Communicator and Collaborator competencies.

Methods

The Team StACER was completed by two geriatricians and interdisciplinary team members based on observations during a geriatric medicine team meeting. Postgraduate trainees were recruited from July 2010–November 2013. Inter-rater reliability between two geriatricians and between all team members was determined. Internal consistency of items for the constructs Communicator and Collaborator competencies was calculated. Raters completed a survey previously administered to Canadian geriatricians to assess face validity. Trainees completed a survey to determine the usefulness of this instrument as a feedback tool.

Results

Thirty postgraduate trainees participated. The prevalence adjusted bias-adjusted kappa range inter-rater reliability for Communicator and Collaborator items were 0.87–1.00 and 0.86–1.00, respectively. The Cronbach’s alpha coefficient for Communicator and Collaborator items was 0.997 (95% CI: 0.993–1.00) and 0.997 (95% CI: 0.997–1.00), respectively. The instrument lacked discriminatory power, as all trainees scored “meets requirements” in the overall assessment. Niney-three per cent and 86% of trainees found feedback useful for developing Communicator and Collaborator competencies, respectively.

Conclusions

The Team StACER has adequate inter-rater reliability and internal consistency. Poor discriminatory power and face validity challenge the merit of using this evaluation tool. Trainees felt the tool provided useful feedback on Collaborator and Communicator competencies.

Downloads

Download data is not yet available.

Downloads

Published

2016-10-31

How to Cite

1.
Wong CL, Norris M, Sinha SS, Zorzitto ML, Madala S, Hamid JS. Validity, Reliability and Acceptability of the Team Standardized Assessment of Clinical Encounter Report*. Can Geriatr J [Internet]. 2016 Oct. 31 [cited 2024 Feb. 25];19(4):182-8. Available from: https://cgjonline.ca/index.php/cgj/article/view/234

Issue

Section

Original Research