Accurately interpreting clickthrough data as implicit feedback
T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay.
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, page 154--161. New York, NY, USA, ACM, (2005)

This paper examines the reliability of implicit feedback generated from clickthrough data in WWW search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average.

URL

http://doi.acm.org/10.1145/1076034.1076063

search on

This publication has not been reviewed yet.

rating distribution

average user rating0.0 out of 5.0 based on 0 reviews

Please log in to take part in the discussion (add own reviews or comments).

@inproceedings{joachims2005accurately,
  abstract = {This paper examines the reliability of implicit feedback generated from clickthrough data in WWW search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average.},
  acmid = {1076063},
  added-at = {2012-10-23T09:27:21.000+0200},
  address = {New York, NY, USA},
  author = {Joachims, Thorsten and Granka, Laura and Pan, Bing and Hembrooke, Helene and Gay, Geri},
  biburl = {https://puma.uni-kassel.de/bibtex/28c488477626fa59db419ac77f3552029/jaeschke},
  booktitle = {Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval},
  doi = {10.1145/1076034.1076063},
  interhash = {050982b76855a6b1258ed0b40cb69018},
  intrahash = {8c488477626fa59db419ac77f3552029},
  isbn = {1-59593-034-5},
  keywords = {click data evaluation feedback implicit search study user web},
  location = {Salvador, Brazil},
  numpages = {8},
  pages = {154--161},
  publisher = {ACM},
  timestamp = {2012-10-23T09:27:21.000+0200},
  title = {Accurately interpreting clickthrough data as implicit feedback},
  url = {http://doi.acm.org/10.1145/1076034.1076063},
  year = 2005
}

%0 Conference Paper
%1 joachims2005accurately
%A Joachims, Thorsten
%A Granka, Laura
%A Pan, Bing
%A Hembrooke, Helene
%A Gay, Geri
%B Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
%C New York, NY, USA
%D 2005
%I ACM
%K click data evaluation feedback implicit search study user web
%P 154--161
%R 10.1145/1076034.1076063
%T Accurately interpreting clickthrough data as implicit feedback
%U http://doi.acm.org/10.1145/1076034.1076063
%X This paper examines the reliability of implicit feedback generated from clickthrough data in WWW search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average.
%@ 1-59593-034-5

PUMA

Accurately interpreting clickthrough data as implicit feedback
T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay.
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, page 154--161. New York, NY, USA, ACM, (2005)

Tags

Users

Comments and Reviews

Cite this publication

PUMA

Accurately interpreting clickthrough data as implicit feedbackT. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, page 154--161. New York, NY, USA, ACM, (2005)

Tags

Users

Comments and Reviews

Cite this publication

Accurately interpreting clickthrough data as implicit feedback
T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay.
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, page 154--161. New York, NY, USA, ACM, (2005)