Surgeons as Educators A Guide for Academic Development and Teaching Excellence

104

Table 6.3

(continued)

Malpani

2015

4 expert surgeons and 14 trainee surgeons

Robotic suturing and knot tying

Anonymous survey of preference for superior task segment performance between paired videos distributed to Johns Hopkins community Computed percentile scores for segment performance using preferences Predicted task-level scores using segment-

level

percentile scores

Inexperienced survey respondents: < 72 h Experts: ~672 h

83% agreement between inexperienced survey respondents and experts Segment score: Spearman’s ρ^

≥

 0.86

Task score: Pearson’s

ρ^

≥ 0.84

$10 gift card/survey

First author

Year

Task performers

Task

Evaluation mechanism

Average time to feedback

Rating agreement between crowds and experts

Compensation

J.C. Dai and M.D. Sorensen