Web-Based Video Assessments of Operative Performance for Remote Telementoring

Alexandra M. Moore, Nicholas H. Carter, Justin P. Wagner, Charles J. Filipi, David C. Chen

Research output: Contribution to journalArticle

Abstract

INTRODUCTION: Performance-based feedback is critical to surgical skills acquisition. Barriers of geography and time limit trainees' access to expert mentorship. In this study, we hypothesized that telementoring using an asynchronous, web-based video interface would allow trainees to receive systematic feedback from expert mentors despite these barriers. MATERIALS AND METHODS: Between October 2014 and October 2016, 18 surgeons in Brazil, Dominican Republic, Haiti, and Paraguay underwent in-person training in Lichtenstein for hernioplasty or laparoscopic total extraperitoneal inguinal hernia repair. After initial training, surgeons submitted 6- to 12-month interval operative videos for expert review. Expert surgeons reviewed each video using the Surgus web platform with performance metrics adapted from the Operative Performance Rating Scale (OPRS). The time required to perform video review, number of freeform comments, mean OPRS scores, and variance of OPRS scores among telementors was assessed. RESULTS: A total of 18 surgeons submitted 20 operative videos, and three expert surgeons reviewed each video using the Surgus platform. The median time to perform video review was 20 minutes. Median number of freeform verbal comments was eight. Mean OPRS overall performance scores were 3.9 ± 0.9 (scale of five). Mean variance in scoring among telementors for overall performance was 0.25 (maximum 5.29), suggesting a high degree of concordance. CONCLUSIONS: Video-based assessments had a high degree of concordance among expert raters. Asynchronous performance reviews by telementors offer opportunities for longitudinal feedback that overcome geographical, material, and temporal disparities. This platform offers a means of sharing expertise in surgical training, continuing education, credentialing, and global health.

Original languageEnglish (US)
Pages (from-to)25-30
Number of pages6
JournalSurgical technology international
Volume30
StatePublished - Jul 25 2017

Fingerprint

Mentors
Herniorrhaphy
Paraguay
Dominican Republic
Haiti
Credentialing
Geography
Inguinal Hernia
Continuing Education
Brazil
Surgeons
Global Health

All Science Journal Classification (ASJC) codes

  • Medicine(all)

Cite this

Web-Based Video Assessments of Operative Performance for Remote Telementoring. / Moore, Alexandra M.; Carter, Nicholas H.; Wagner, Justin P.; Filipi, Charles J.; Chen, David C.

In: Surgical technology international, Vol. 30, 25.07.2017, p. 25-30.

Research output: Contribution to journalArticle

Moore, Alexandra M. ; Carter, Nicholas H. ; Wagner, Justin P. ; Filipi, Charles J. ; Chen, David C. / Web-Based Video Assessments of Operative Performance for Remote Telementoring. In: Surgical technology international. 2017 ; Vol. 30. pp. 25-30.
@article{3ae7a9edb36e4dfe9b3a50629d84b209,
title = "Web-Based Video Assessments of Operative Performance for Remote Telementoring",
abstract = "INTRODUCTION: Performance-based feedback is critical to surgical skills acquisition. Barriers of geography and time limit trainees' access to expert mentorship. In this study, we hypothesized that telementoring using an asynchronous, web-based video interface would allow trainees to receive systematic feedback from expert mentors despite these barriers. MATERIALS AND METHODS: Between October 2014 and October 2016, 18 surgeons in Brazil, Dominican Republic, Haiti, and Paraguay underwent in-person training in Lichtenstein for hernioplasty or laparoscopic total extraperitoneal inguinal hernia repair. After initial training, surgeons submitted 6- to 12-month interval operative videos for expert review. Expert surgeons reviewed each video using the Surgus web platform with performance metrics adapted from the Operative Performance Rating Scale (OPRS). The time required to perform video review, number of freeform comments, mean OPRS scores, and variance of OPRS scores among telementors was assessed. RESULTS: A total of 18 surgeons submitted 20 operative videos, and three expert surgeons reviewed each video using the Surgus platform. The median time to perform video review was 20 minutes. Median number of freeform verbal comments was eight. Mean OPRS overall performance scores were 3.9 ± 0.9 (scale of five). Mean variance in scoring among telementors for overall performance was 0.25 (maximum 5.29), suggesting a high degree of concordance. CONCLUSIONS: Video-based assessments had a high degree of concordance among expert raters. Asynchronous performance reviews by telementors offer opportunities for longitudinal feedback that overcome geographical, material, and temporal disparities. This platform offers a means of sharing expertise in surgical training, continuing education, credentialing, and global health.",
author = "Moore, {Alexandra M.} and Carter, {Nicholas H.} and Wagner, {Justin P.} and Filipi, {Charles J.} and Chen, {David C.}",
year = "2017",
month = "7",
day = "25",
language = "English (US)",
volume = "30",
pages = "25--30",
journal = "Surgical technology international",
issn = "1090-3941",
publisher = "Universal Medical Press",

}

TY - JOUR

T1 - Web-Based Video Assessments of Operative Performance for Remote Telementoring

AU - Moore, Alexandra M.

AU - Carter, Nicholas H.

AU - Wagner, Justin P.

AU - Filipi, Charles J.

AU - Chen, David C.

PY - 2017/7/25

Y1 - 2017/7/25

N2 - INTRODUCTION: Performance-based feedback is critical to surgical skills acquisition. Barriers of geography and time limit trainees' access to expert mentorship. In this study, we hypothesized that telementoring using an asynchronous, web-based video interface would allow trainees to receive systematic feedback from expert mentors despite these barriers. MATERIALS AND METHODS: Between October 2014 and October 2016, 18 surgeons in Brazil, Dominican Republic, Haiti, and Paraguay underwent in-person training in Lichtenstein for hernioplasty or laparoscopic total extraperitoneal inguinal hernia repair. After initial training, surgeons submitted 6- to 12-month interval operative videos for expert review. Expert surgeons reviewed each video using the Surgus web platform with performance metrics adapted from the Operative Performance Rating Scale (OPRS). The time required to perform video review, number of freeform comments, mean OPRS scores, and variance of OPRS scores among telementors was assessed. RESULTS: A total of 18 surgeons submitted 20 operative videos, and three expert surgeons reviewed each video using the Surgus platform. The median time to perform video review was 20 minutes. Median number of freeform verbal comments was eight. Mean OPRS overall performance scores were 3.9 ± 0.9 (scale of five). Mean variance in scoring among telementors for overall performance was 0.25 (maximum 5.29), suggesting a high degree of concordance. CONCLUSIONS: Video-based assessments had a high degree of concordance among expert raters. Asynchronous performance reviews by telementors offer opportunities for longitudinal feedback that overcome geographical, material, and temporal disparities. This platform offers a means of sharing expertise in surgical training, continuing education, credentialing, and global health.

AB - INTRODUCTION: Performance-based feedback is critical to surgical skills acquisition. Barriers of geography and time limit trainees' access to expert mentorship. In this study, we hypothesized that telementoring using an asynchronous, web-based video interface would allow trainees to receive systematic feedback from expert mentors despite these barriers. MATERIALS AND METHODS: Between October 2014 and October 2016, 18 surgeons in Brazil, Dominican Republic, Haiti, and Paraguay underwent in-person training in Lichtenstein for hernioplasty or laparoscopic total extraperitoneal inguinal hernia repair. After initial training, surgeons submitted 6- to 12-month interval operative videos for expert review. Expert surgeons reviewed each video using the Surgus web platform with performance metrics adapted from the Operative Performance Rating Scale (OPRS). The time required to perform video review, number of freeform comments, mean OPRS scores, and variance of OPRS scores among telementors was assessed. RESULTS: A total of 18 surgeons submitted 20 operative videos, and three expert surgeons reviewed each video using the Surgus platform. The median time to perform video review was 20 minutes. Median number of freeform verbal comments was eight. Mean OPRS overall performance scores were 3.9 ± 0.9 (scale of five). Mean variance in scoring among telementors for overall performance was 0.25 (maximum 5.29), suggesting a high degree of concordance. CONCLUSIONS: Video-based assessments had a high degree of concordance among expert raters. Asynchronous performance reviews by telementors offer opportunities for longitudinal feedback that overcome geographical, material, and temporal disparities. This platform offers a means of sharing expertise in surgical training, continuing education, credentialing, and global health.

UR - http://www.scopus.com/inward/record.url?scp=85056928162&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056928162&partnerID=8YFLogxK

M3 - Article

C2 - 28695970

AN - SCOPUS:85056928162

VL - 30

SP - 25

EP - 30

JO - Surgical technology international

JF - Surgical technology international

SN - 1090-3941

ER -