Paper in IJCARS (2016) on “Automated video-based assessment of surgical skills for training and evaluation in medical schools”

Paper

@article{2016-Zia-AVASSTEMS,

title = {Automated video-based assessment of surgical skills for training and evaluation in medical schools},

author = {Aneeq Zia and Yachna Sharma and Vinay Bettadapura and Eric Sarin and Thomas Ploetz and Mark Clements and Irfan Essa},

url = {http://link.springer.com/article/10.1007/s11548-016-1468-2

https://pubmed.ncbi.nlm.nih.gov/27567917/},

doi = {10.1007/s11548-016-1468-2},

year  = {2016},

date = {2016-09-01},

urldate = {2016-09-01},

journal = {International Journal of Computer Assisted Radiology and Surgery},

volume = {11},

number = {9},

pages = {1623--1636},

publisher = {Springer Berlin Heidelberg},

abstract = {Routine evaluation of basic surgical skills in medical schools requires considerable time and effort from supervising faculty. For each surgical trainee, a supervisor has to observe the trainees in person. Alternatively, supervisors may use training videos, which reduces some of the logistical overhead. All these approaches however are still incredibly time consuming and involve human bias. In this paper, we present an automated system for surgical skills assessment by analyzing video data of surgical activities.



},

keywords = {activity assessment, computational health, IJCARS, surgical training},

pubstate = {published},

tppubtype = {article}

}

Abstract

Purpose: Routine evaluation of basic surgical skills in medical schools requires considerable time and effort from supervising faculty. For each surgical trainee, a supervisor has to observe the trainees in-person. Alternatively, supervisors may use training videos, which reduces some of the logistical overhead. All these approaches, however, are still incredibly time-consuming and involve human bias. In this paper, we present an automated system for surgical skills assessment by analyzing video data of surgical activities.
Method : We compare different techniques for video-based surgical skill evaluation. We use techniques that capture the motion information at a coarser granularity using symbols or words, extract motion dynamics using textural patterns in a frame kernel matrix, and analyze fine-grained motion information using frequency analysis. Results: We were successfully able to classify surgeons into different skill levels with high accuracy. Our results indicate that fine-grained analysis of motion dynamics via frequency analysis is most effective in capturing the skill-relevant information in surgical videos.
Conclusion: Our evaluations show that frequency features perform better than motion texture features, which in turn perform better than symbol/word-based features. Put succinctly, skill classification accuracy is positively correlated with motion granularity as demonstrated by our results on two challenging video datasets.