A tale of P-matrices and TripleSpinners - the unreasonable effectiveness of structured models in nonlinear embeddings

Add to your list(s) Download to your calendar using vCal

• Krzysztof Choromanski, Google NY
• Thursday 24 November 2016, 11:00-12:00
• CBL Room BE-438.

If you have a question about this talk, please contact Adrian Weller.

In this talk we will present new generic paradigms for conducting machine learning computations with structured linear projections. These paradigms can be applied to speed up several machine learning algorithms based on random linear projections such as: cross-polytope LSH techniques, kernel approximations via random feature maps, quantization methods using random projection trees, several variants of Johnson-Lindenstrauss transforms, and many more.

Their adaptive versions can be applied in neural network architectures to construct much more compact and faster yet still good quality neural network models. As a byproduct, we give the first theoretical guarantees regarding the fastest known cross-polytope LSH methods based on the Walsh-Hadamard Transform.

The proposed structured families of P-model and TripleSpin matrices cover as special cases all structured matrices used so far in this context, but also include new structured constructions not considered previously.

Bio: Krzysztof Choromanski is a member of the Google Brain Robotics Team in New York. He works on several problems regarding robotics and machine learning such as: reinforcement learning, control theory, state estimation, predictive state representation and Hilbert embeddings of dynamical systems. His research interests include also neural networks and the theory of structured nonlinear embeddings. The latter are used in several machine learning applications such as: compact neural networks with fast inference, kernel approximation techniques via random feature maps, and the fastest known cross-polytope LSH algorithms. Krzysztof plays piano and is an avid salsa dancer.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL Room BE-438
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.