Omar Alonso, Daniel E. Rose, und Benjamin Stewart. Crowdsourcing for relevance evaluation. SIGIR Forum, (42)2:9--15, ACM, New York, NY, USA, November 2008. [PUMA: ir crowdsourcing relevance evaluation] URL