107
Powers
2016
5 surgeons
PGY3 and PGY 4 urology residents
Attending surgeons
Intraoperative renal artery and vein dissection during live robotic partial nephrectomy
GEARS
a
Novel five-point scale for hilar dissection
Turk workers: 11 h, 33 min Surgeons: 13 days
Surgeon-level GEARS ratings: Pearson’s
r = 0.84
Video-level GEARS ratings: Pearson’s
r = 0.82
Force sensitivity domain: Pearson’s r = 0.35 Pearson’s
r for
remainder of GEARS domains = 0.76–0.83 Renal artery specific rating: Pearson’s
r = 0.83
N/A
Ghani
2016
Practicing urologists in the state of Michigan, enrolled in Michigan Urological Surgery Improvement Collaborative (MUSIC)
Live video from nerve-sparing robotic-assisted laparoscopic radical prostatectomy
Bladder neck dissection
Apical dissection
Nerve sparing
Urethrovesical anastomosis
GEARS
a
Robotic Anastomosis and Competency Evaluation (RACE) for anastomosis performanceSummary pass/fail
Turk workers: 21 h for GEARS; 38 h for RACE Surgeons: 15 days for both ratings
GEARS: Pearson’s r = 0.78 RACE: Pearson’s r = 0.74 Identical evaluation of relative passing rate for each surgeon
N/A
(continued)
6 Crowdsourcing and Large-Scale Evaluation