Using Crowdsourcing and Active Learning to Track Sentiment in Online Media.
In: H. Coelho, R. Studer and M. Wooldridge, editors,
Proceedings of the 19th European Conference on Artificial Intelligence, volume 215, series Frontiers in Artificial Intelligence and Applications, pages 145-150.
IOS Press, Amsterdam, The Netherlands, The Netherlands, 2010.
Anthony Brew, Derek Greene and Pádraig Cunningham.
[doi]
[abstract]
[BibTeX]
Tracking sentiment in the popular media has long been of interest to media analysts and pundits. With the availability of news content via online syndicated feeds, it is now possible to automate some aspects of this process. There is also great potential to crowdsource Crowdsourcing is a term, sometimes associated with Web 2.0 technologies, that describes outsourcing of tasks to a large often anonymous community. much of the annotation work that is required to train a machine learning system to perform sentiment scoring. We describe such a system for tracking economic sentiment in online media that has been deployed since August 2009. It uses annotations provided by a cohort of non-expert annotators to train a learning system to classify a large body of news items. We report on the design challenges addressed in managing the effort of the annotators and in making annotation an interesting experience.