Human Computing and Crowdsourcing in Search

Add to your list(s) Download to your calendar using vCal

• Gabriella Kazai, Microsoft Research
• Tuesday 03 July 2012, 16:45-17:45
• Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge.

If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins.

This event may be recorded and made available internally or externally via http://research.microsoft.com. Microsoft will own the copyright of any recordings made. If you do not wish to have your image/voice recorded please consider this before attending

Human Computation is an emerging paradigm that organizes human efforts to carry out a computation or task that computers cannot do well, like detecting objects in videos. In this paradigm, humans become a type of processing unit and crowdsourcing serves as a tool for distributing computations to humans. In recent years, crowdsourcing has been popularized by commercial crowdsourcing platforms like Amazon’s Mechanical Turk and has reached an industrial scale, involving millions of Internet users who offer the human processing power. However, unlike CPUs, humans are, well, humans and are influenced by a great many things, including their own motives and aspects of the computation task.

In this lecture we use the evaluation of search engines as a context for studying various aspects of crowdsourcing. In order to measure the performance of a search engine human assessments of search results are needed. Since online search engines involve millions of queries a day and at least 10 times as many retrieved documents, such a task seems like a perfect match for human computing. However, there are many issues to consider, as we will show through a number of experiments conducted using Amazon’s Mechanical Turk.

This talk is part of the Microsoft Research Cambridge, public talks series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge University Engineering Department Talks
• Centre for Smart Infrastructure & Construction
• Featured lists
• Methodology in design research
• Microsoft Research Cambridge, public talks
• School of Technology
• Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge
• de239's list
• engineering

Note that ex-directory lists are not shown.