TY - CONF AU - Little, Greg AU - Chilton, Lydia B. AU - Goldman, Max AU - Miller, Robert C. A2 - T1 - TurKit: human computation algorithms on mechanical turk T2 - Proceedings of the 23nd annual ACM symposium on User interface software and technology PB - ACM CY - New York, NY, USA PY - 2010/ M2 - VL - IS - SP - 57 EP - 66 UR - http://doi.acm.org/10.1145/1866029.1866040 M3 - 10.1145/1866029.1866040 KW - algorithm KW - human KW - intelligence KW - social KW - computing KW - cirg KW - collective KW - turkit L1 - SN - 978-1-4503-0271-5 N1 - N1 - AB - Mechanical Turk (MTurk) provides an on-demand source of human computation. This provides a tremendous opportunity to explore algorithms which incorporate human computation as a function call. However, various systems challenges make this difficult in practice, and most uses of MTurk post large numbers of independent tasks. TurKit is a toolkit for prototyping and exploring algorithmic human computation, while maintaining a straight-forward imperative programming style. We present the crash-and-rerun programming model that makes TurKit possible, along with a variety of applications for human computation algorithms. We also present case studies of TurKit used for real experiments across different fields. ER -