Unsupervised Domain Adaptation for Neural Search
- đ¤ Speaker: Nils Reimers, HuggingFace
- đ Date & Time: Thursday 03 February 2022, 11:00 - 12:00
- đ Venue: https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
Abstract
After textual information retrieval has stalled for many years, pre-trained transformer networks gave a big performance boost resulting in extremely better search results. However, so far these approaches require large amount of training data which is seldom available for many use-cases. In this talk, I will start with an overview of different neural search approach. I will then present BEIR , a benchmark that test neural search methods in an out-of-domain setting. As the benchmark reveals, many architecture are sensitive to domain shifts limiting their usefulness for many real word applications. To overcome this short-coming, we created Generative Pseudo Labeling (GPL), a method that transfers knowledge from slow, but robust architectures, to fast but domain-sensitive approaches, which results in highly improved search quality.
Series This talk is part of the Language Technology Lab Seminars series.
Included in Lists
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Chris Davis' list
- Guy Emerson's list
- https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
- Interested Talks
- Language Sciences for Graduate Students
- Language Technology Lab Seminars
- ndk22's list
- ob366-ai4er
- rp587
- Simon Baker's List
- Trust & Technology Initiative - interesting events
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Thursday 03 February 2022, 11:00-12:00