Surgeons as Educators A Guide for Academic Development and Teaching Excellence

51

receive will sharpen your work further, and publication of your work will allow
others to consider using the tool you’ve developed. There’s no measure of validity
that quite compares to seeing other teachers use your tool to assess their students.

References and Further Reading

1. Artino AR Jr, La Rochelle JS, Dezee KJ, Gehlbach H. Developing questionnaires for educa-
   tional research: AMEE guide no. 87. Med Teach. 2014;36(6):463–74.


2. Artino AR Jr, Gehlbach H, Durning SJ. AM last page: avoiding five common pitfalls of survey
   design. Acad Med. 2011;86(10):1327.


3. Benson A, Markwell S, Kohler TS, Tarter TH.  An operative performance rating system for
   urology residents. J Urol. 2012;188(5):1877–82.


4. Downing SM.  Validity: on the meaningful interpretation of assessment data. Med Educ.
   2003;37(9):830–7.


5. Duckworth AL, Peterson C, Matthews MD, Kelly DR. Grit: perseverance and passion for long-
   term goals. J Pers Soc Psychol. 2007;92(6):1087.


6. Duckworth AL, Quinn PD.  Development and validation of the short grit scale (GRIT–S). J
   Pers Assess. 2009;91(2):166–74.


7. Hitt CE. Just filling in the bubbles: using careless answer patterns on surveys as a proxy mea-
   sure of noncognitive skills. Chapter in Doctoral Dissertation (Character Assessment: Three
   Essays). Fayetteville: Department of Education Reform, University of Arkansas; 2016.


8. Gehlbach H. Seven survey sins. The Journal of Early Adolescence. 2015;35(5–6):883–97.


9. Gehlbach H, Brinkworth ME.  Measure twice, cut down error: a process for enhancing the
   validity of survey scales. Rev Gen Psychol. 2011;15(4):380.


10. Larson JL, Williams RG, Ketchum J, Boehler ML, Dunnington GL. Feasibility, reliability and
    validity of an operative performance rating system for evaluating surgery residents. Surgery.
    2005;138(4):640–9.


11. Poropat AE.  Other-rated personality and academic performance: evidence and implications.
    Learn Individ Differ. 2014;34:24–32.


12. Roberts BW, Lejuez C, Krueger RF, Richards JM, Hill PL. What is conscientiousness and how
    can it be assessed? Dev Psychol. 2014;50(5):1315.


13. Salles A, Cohen GL, Mueller CM. The relationship between grit and resident well-being. Am
    J Surg. 2014;207(2):251–4.


14. Willis GB, Artino AR Jr. What do our respondents think We’re asking? Using cognitive inter-
    viewing to improve medical education surveys. J Grad Med Educ. 2013;5(3):353–6.


15. Zamarro GE, Cheng A, Shakeel M, Hitt C. Comparing and validating measures of character
    skills: Findings from a nationally representative sample, 4th coming, J Behav Exp Econ.

4 Measurement in Education: A Primer on Designing Assessments