Crowdsourced Databases: Query Processing with People
A. Marcus, E. Wu, S. Madden, and R. Miller.
Proceedings of the 5th Biennial Conference on Innovative Data Systems Research, page 211--214. CIDR, (January 2011)

Amazon's Mechanical Turk (\MTurk") service allows users to post short tasks (\HITs") that other users can receive a small amount of money for completing. Common tasks on the system include labelling a collection of images, com- bining two sets of images to identify people which appear in both, or extracting sentiment from a corpus of text snippets. Designing a work ow of various kinds of HITs for ltering, aggregating, sorting, and joining data sources together is common, and comes with a set of challenges in optimizing the cost per HIT, the overall time to task completion, and the accuracy of MTurk results. We propose Qurk, a novel query system for managing these work ows, allowing crowd- powered processing of relational databases. We describe a number of query execution and optimization challenges, and discuss some potential solutions.

URL

http://dspace.mit.edu/handle/1721.1/62827

search on

This publication has not been reviewed yet.

rating distribution

average user rating0.0 out of 5.0 based on 0 reviews

Please log in to take part in the discussion (add own reviews or comments).

@inproceedings{marcus2011crowdsourced,
  abstract = {Amazon's Mechanical Turk (\MTurk") service allows users to post short tasks (\HITs") that other users can receive a small amount of money for completing. Common tasks on the system include labelling a collection of images, com- bining two sets of images to identify people which appear in both, or extracting sentiment from a corpus of text snippets. Designing a work ow of various kinds of HITs for ltering, aggregating, sorting, and joining data sources together is common, and comes with a set of challenges in optimizing the cost per HIT, the overall time to task completion, and the accuracy of MTurk results. We propose Qurk, a novel query system for managing these work ows, allowing crowd- powered processing of relational databases. We describe a number of query execution and optimization challenges, and discuss some potential solutions.},
  added-at = {2012-06-19T16:29:05.000+0200},
  author = {Marcus, Adam and Wu, Eugene and Madden, Samuel and Miller, Robert C.},
  biburl = {https://puma.uni-kassel.de/bibtex/229723ba38aa6039091769cd2f69a1514/jaeschke},
  booktitle = {Proceedings of the 5th Biennial Conference on Innovative Data Systems Research},
  doi = {1721.1/62827},
  interhash = {b6b7d67c3c09259fb2d5df3f52e24c9d},
  intrahash = {29723ba38aa6039091769cd2f69a1514},
  keywords = {cirg collective computing crowdsourcing database intelligence query social},
  month = jan,
  pages = {211--214},
  publisher = {CIDR},
  timestamp = {2012-06-19T16:29:06.000+0200},
  title = {Crowdsourced Databases: Query Processing with People},
  url = {http://dspace.mit.edu/handle/1721.1/62827},
  year = 2011
}

%0 Conference Paper
%1 marcus2011crowdsourced
%A Marcus, Adam
%A Wu, Eugene
%A Madden, Samuel
%A Miller, Robert C.
%B Proceedings of the 5th Biennial Conference on Innovative Data Systems Research
%D 2011
%I CIDR
%K cirg collective computing crowdsourcing database intelligence query social
%P 211--214
%R 1721.1/62827
%T Crowdsourced Databases: Query Processing with People
%U http://dspace.mit.edu/handle/1721.1/62827
%X Amazon's Mechanical Turk (\MTurk") service allows users to post short tasks (\HITs") that other users can receive a small amount of money for completing. Common tasks on the system include labelling a collection of images, com- bining two sets of images to identify people which appear in both, or extracting sentiment from a corpus of text snippets. Designing a work ow of various kinds of HITs for ltering, aggregating, sorting, and joining data sources together is common, and comes with a set of challenges in optimizing the cost per HIT, the overall time to task completion, and the accuracy of MTurk results. We propose Qurk, a novel query system for managing these work ows, allowing crowd- powered processing of relational databases. We describe a number of query execution and optimization challenges, and discuss some potential solutions.

PUMA

Crowdsourced Databases: Query Processing with People
A. Marcus, E. Wu, S. Madden, and R. Miller.
Proceedings of the 5th Biennial Conference on Innovative Data Systems Research, page 211--214. CIDR, (January 2011)

Tags

Users

Comments and Reviews

Cite this publication

PUMA

Crowdsourced Databases: Query Processing with PeopleA. Marcus, E. Wu, S. Madden, and R. Miller. Proceedings of the 5th Biennial Conference on Innovative Data Systems Research, page 211--214. CIDR, (January 2011)

Tags

Users

Comments and Reviews

Cite this publication

Crowdsourced Databases: Query Processing with People
A. Marcus, E. Wu, S. Madden, and R. Miller.
Proceedings of the 5th Biennial Conference on Innovative Data Systems Research, page 211--214. CIDR, (January 2011)