Convex low-rank models: from matrices to tensors

Add to your list(s) Download to your calendar using vCal

• Ryota Tomioka, Toyota Technological Institute at Chicago
• Tuesday 10 March 2015, 13:30-14:30
• Auditorium, Microsoft Research Ltd, 21 Station Road, Cambridge, CB1 2FB.

If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins.

This event may be recorded and made available internally or externally via http://research.microsoft.com. Microsoft will own the copyright of any recordings made. If you do not wish to have your image/voice recorded please consider this before attending

In this talk I will present low-rank models in two domains and how they can be set-up as convex optimization problems. The fist domain is the so-called brain-computer interface. The problem of learning a set of discriminative spatio-temporal filters for the P300 speller system is formulated as a low-rank matrix learning problem. Using the trace norm regularization combined with an appropriately defined likelihood function I obtained both state-of-the art classification performance and highly interpretable spatio-temporal filters. The second domain is audio-signal separation. I propose positive semidefinite tensor factorization (PSDTF), which is a generalization of nonnegative matrix factorization (NMF), that decomposes a collection of PSD matrices into linear combinations of a small number of basis PSD matrices. I propose a non-parametric Bayesian model for PSDTF that automatically infers the number of basis PSD matrices. Finally, I present an ongoing work on convex relaxation of tensor (multilinear)-rank. I propose generalizations of trace norm for tensors and analyze their statistical performance. The wide gap between the performance that can be obtained by tractable algorithms and that can only be obtained by intractable algorithms points to an optimization-statistics tradeoff that opens up many future direction. Includes joint work with Klaus-Robert Müller, Kazuyoshi Yoshii, Daichi Mochihashi, Masataka Goto, Taiji Suzuki, Kohei Hayashi, and Hisashi Kashima.

This talk is part of the Microsoft Research Cambridge, public talks series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Auditorium, Microsoft Research Ltd, 21 Station Road, Cambridge, CB1 2FB
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Microsoft Research Cambridge, public talks
• Optics for the Cloud
• PMRFPS's
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• personal list
• rp587

Note that ex-directory lists are not shown.