Alonso, Omar, Rose, Daniel E. and Stewart, Benjamin. "Crowdsourcing for relevance evaluation." SIGIR Forum 42 , no. 2 (2008): 9--15.