Optimization in the space of probabilities with MCMC: Uncertainty quantification and sequential decision making
- Series
- Applied and Computational Mathematics Seminar
- Time
- Monday, April 5, 2021 - 14:00 for 1 hour (actually 50 minutes)
- Location
- ONLINE https://bluejeans.com/884917410
- Speaker
- Prof. Yian Ma – UCSD
I will present MCMC algorithms as optimization over the KL-divergence in the space of probabilities. By incorporating a momentum variable, I will discuss an algorithm which performs accelerated gradient descent over the KL-divergence. Using optimization-like ideas, a suitable Lyapunov function is constructed to prove that an accelerated convergence rate is obtained. I will then discuss how MCMC algorithms compare against variational inference methods in parameterizing the gradient flows in the space of probabilities and how it applies to sequential decision making problems.