Category: Clinical Practice (assessment, diagnosis, treatment, knowledge translation/EBP, implementation science, program development); Measurement
Objective(s) : The ACGME requires PM&R residents to complete a total of 440 procedures during residency. Procedure-heavy specialties such as surgery have generated a wealth of literature on tools for evaluating residents and fellows on their procedural skills during training. However, a standardized tool to evaluate proficiency of technical skills in PM&R has not fully been studied. No review to date has included studies that utilize new technologies for assessing resident skills in PM&R procedures. The objective of this work is to review and evaluate various assessment tools for procedural learning, particularly ones that incorporate new technologies.
Data Sources : A systematic review was conducted according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines. We conducted a search using PubMed MEDLINE (2011 to December 2017) using the key words: assessment, checklist, observational tool, procedure list, direct observation, procedural learning, operative skills, procedural skills, intraoperative performance, performance measure, mobile, web, web-based, real-time, and web application to which logical operands were applied.
Study Selection : NA
Data Extraction : NA
Data Synthesis : Our search returned research papers detailing procedural skills assessment of residents and fellows. Among these we identified four main tools that we felt met additional Van der Vleuten criteria with respect to reliability, validity, impact and acceptability to learners and faculty and cost. We will be discussing those that fit this criteria, among them -- QR Reader, SIMPL, Cumulative Sum analysis (CUSUM), and mobile OPRS.
Conclusions : Within the articles surveyed, there exists variation in measurement tools incorporating new technologies. This review highlights the differences, similarities, successes, and shortcomings among the various types of assessment methods that may be applied to residents learning new procedures during their PM&R training.
Allison Glinka Przybysz– Resident, Schwab Rehabilitation Hospital, Chicago, Illinois