Logistic and Softmax Regression, and their Relation to the Neural Network World

Add to your list(s) Download to your calendar using vCal

• Adrian Scoica (University of Cambridge)
• Monday 19 May 2014, 14:00-15:00
• LT2, Computer Laboratory, William Gates Building.

If you have a question about this talk, please contact Advait Sarkar.

Logistic Regression, along with its generalized counterpart Softmax Regression, is one of the most popular and best-performing generalized linear classification algorithms currently used in Machine Learning. In this lecture, I will explain some of the intuitions behind using and training these classifiers, and I will show how they are related to Neural Networks.

Using cleverly assembled examples from the harsh and unforgiving world of dating, I will reveal the probabilistic concepts that lie behind the logistic function. I will demonstrate how to train a binary logistic regression classifier using gradient descent, and I will show how those intuitions generalize naturally to the multi-class problem. Last but not least, we will see how these classifiers can be thought of as very simple Artificial Neural Networks, and thus can be used as layer components in more complicated Neural Network architectures.

The slides can be viewed here.

This talk is part of the Computer Laboratory Research Students' Lectures 2014 series.

This talk is included in these lists:

• Computer Laboratory Research Students' Lectures 2014
• LT2, Computer Laboratory, William Gates Building

Note that ex-directory lists are not shown.