Learning Backward Compatible Embeddings

Add to your list(s) Download to your calendar using vCal

• Weihua Hu, Stanford University and Google
• Friday 02 September 2022, 16:00-17:00
• Lecture Theatre 2 (https://cl-cam-ac-uk.zoom.us/j/92564083880?pwd=Wk5DVWpUc2lIN0krMFU5azEwUGpEUT09).

If you have a question about this talk, please contact Pietro Lio.

hybrid event (https://cl-cam-ac-uk.zoom.us/j/92564083880?pwd=Wk5DVWpUc2lIN0krMFU5azEwUGpEUT09)

Embeddings, low-dimensional vector representation of objects, are fundamental in building modern machine learning systems. In industrial settings, there is usually an embedding team that trains an embedding model to solve intended tasks (e.g., product recommendation). The produced embeddings are then widely consumed by consumer teams to solve their unintended tasks (e.g., fraud detection). However, as the embedding model gets updated and retrained to improve performance on the intended task, the newly-generated embeddings are no longer compatible with the existing consumer models. Here we study the problem of embedding version updates and their backward compatibility. We formalize the problem where the goal is for the embedding team to keep updating the embedding version, while the consumer teams do not have to retrain their models. We develop a solution based on learning backward compatible embeddings, which allows the embedding model version to be updated frequently, while also allowing the latest version of the embedding to be quickly transformed into any backward compatible historical version of it, so that consumer teams do not have to retrain their models. We explore different design choices under our framework and show effectiveness of our approach.

This talk is part of the Artificial Intelligence Research Group Talks (Computer Laboratory) series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Artificial Intelligence Research Group Talks (Computer Laboratory)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• Lecture Theatre 2 (https://cl-cam-ac-uk.zoom.us/j/92564083880?pwd=Wk5DVWpUc2lIN0krMFU5azEwUGpEUT09)
• School of Technology
• Speech Seminars
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list
• yk449

Note that ex-directory lists are not shown.