Reparameterizing Bayesian PCA using Householder transformations to break the rotational symmetry.

Add to your list(s) Download to your calendar using vCal

• Rajbir Nirwan, Department of Computer Science, Goethe University, Frankfurt, Germany
• Friday 04 December 2020, 13:15-14:00
• https://dtudk.zoom.us/j/65731683392.

If you have a question about this talk, please contact Francisco Vargas.

Paper:

This talk will be based on this paper.

Abstract:

We consider probabilistic PCA and related factor models from a Bayesian perspective. These models are in general not identifiable as the likelihood has a rotational symmetry. This gives rise to complicated posterior distributions with continuous subspaces of equal density and thus hinders efficiency of inference as well as interpretation of obtained parameters. In particular, posterior averages over factor loadings become meaningless and only model predictions are unambiguous. Here, we propose a parameterization based on Householder transformations, which remove the rotational symmetry of the posterior. Furthermore, by relying on results from random matrix theory, we establish the parameter distribution which leaves the model unchanged compared to the original rotationally symmetric formulation. In particular, we avoid the need to compute the Jacobian determinant of the parameter transformation. This allows us to efficiently implement probabilistic PCA in a rotation invariant fashion in any state of the art toolbox. Here, we implemented our model in the probabilistic programming language Stan and illustrate it on several examples.

Keywords: Probabilistic PCA , Bayesian pPCA, Disentangled Representations, Rotational Invariance, Householder transform.

About the Speaker:

NA

Website: NA

Part of ML@CL Seminar Series focusing on early career researchers in topics relevant to machine learning and statistics.

This talk is part of the ML@CL Seminar Series series.

This talk is included in these lists:

• Hanchen DaDaDash
• ML@CL Seminar Series
• https://dtudk.zoom.us/j/65731683392

Note that ex-directory lists are not shown.