Estimating High-dimensional Gaussian Tails

Series
High Dimensional Seminar
Time
Wednesday, November 14, 2018 - 12:55pm for 1 hour (actually 50 minutes)
Location
Skiles 006
Speaker
Ben Cousins – Columbia University – b.cousins@columbia.edu
Organizer
Konstantin Tikhomirov

The following is a well-known and difficult problem in rare event simulation: given a set and a Gaussian distribution, estimate the probability that a sample from the Gaussian distribution falls outside the set. Previous approaches to this question are generally inefficient in high dimensions. One key challenge with this problem is that the probability of interest is normally extremely small. I'll discuss a new, provably efficient method to solve this problem for a general polytope and general Gaussian distribution. Moreover, in practice, the algorithm seems to substantially outperform our theoretical guarantees and we conjecture that our analysis is not tight. Proving the desired efficiency relies on a careful analysis of (highly) correlated functions of a Gaussian random vector.Joint work with Ton Dieker.