Georgia Institute of Technology College of Sciences

Many numerical methods have been developed in the past years for computing weak solutions (with shock waves) to nonlinear hyperbolic conservation laws. My research, specifically, concerns the design of well-balanced numerical algorithms that preserve certain key structure of these equations in various applications, including for problems involving moving phase boundaries and other scale-dependent interfaces. In particular, in this lecture, I will focus on the evolution of a compressible fluid in spherical symmetry on a Schwarzschild curved background, for which I have designed a class of well-balanced numerical algorithms up to third-order of accuracy. Both the relativistic Burgers-Schwarzschild model and the relativistic Euler-Schwarzschild model were considered, and the proposed numerical algorithm took advantage of the explicit or implicit forms available for the stationary solutions of these models. The schemes follow the finite volume methodology and preserve the stationary solutions and, most importantly, allow us to investigate the global asymptotic behavior of such flows and determine the asymptotic behavior of the mass density and velocity field of the fluid. Blog: philippelefloch.org

The sparse solution obtained from greedy-based optimization approach such as orthogonal matching pursuit can be very useful and have many applications in different directions. In this talk, I will present two research projects, one is about semi-supervised local clustering, and the other is about function approximation, which make use of the sparse solution technique. We will show that the target cluster can be effectively retrieved in the local clustering task and the curse of dimensionality can be overcome for a dense subclass of the space of continuous functions via Kolmogorov superposition theorem. Both the theoretical and numerical results will be discussed.

Geometry arises in myriad ways within machine learning and related areas. I this talk I will focus on settings where geometry helps us understand problems in machine learning, optimization, and sampling. For instance, when sampling from densities supported on a manifold, understanding geometry and the impact of curvature are crucial; surprisingly, progress on geometric sampling theory helps us understand certain generalization properties of SGD for deep-learning! Another fascinating viewpoint afforded by geometry is in non-convex optimization: geometry can either help us make training algorithms more practical (e.g., in deep learning), it can reveal tractability despite non-convexity (e.g., via geodesically convex optimization), or it can simply help us understand existing methods better (e.g., SGD, eigenvector computation, etc.).

Ultimately, I hope to offer the audience some insights into geometric thinking and share with them some new tools that help us design, understand, and analyze models and algorithms. To make the discussion concrete I will recall a few foundational results arising from our research, provide several examples, and note some open problems.

––
Bio: Suvrit Sra is a Alexander von Humboldt Professor of Artificial Intelligence at the Technical University of Munich (Germany), and and Associate Professor of EECS at MIT (USA), where he is also a member of the Laboratory for Information and Decision Systems (LIDS) and of the Institute for Data, Systems, and Society (IDSS). He obtained his PhD in Computer Science from the University of Texas at Austin. Before TUM & MIT, he was a Senior Research Scientist at the Max Planck Institute for Intelligent Systems, Tübingen, Germany. He has held visiting positions at UC Berkeley (EECS) and Carnegie Mellon University (Machine Learning Department) during 2013-2014. His research bridges mathematical topics such as differential geometry, matrix analysis, convex analysis, probability theory, and optimization with machine learning. He founded the OPT (Optimization for Machine Learning) series of workshops, held from OPT2008–2017 at the NeurIPS  conference. He has co-edited a book with the same name (MIT Press, 2011). He is also a co-founder and chief scientist of Pendulum, a global AI+logistics startup.

In many applications across science and engineering it is common to have access to disparate types of data or models with different levels of fidelity. In general, low-fidelity data are easier to obtain in greater quantities, but it may be too inaccurate or not dense enough to accurately train a machine learning model. High-fidelity data is costly to obtain, so there may not be sufficient data to use in training, however, it is more accurate.  A small amount of high-fidelity data, such as from measurements or simulations, combined with low fidelity data, can improve predictions when used together. The important step in such constructions is the representation of the correlations between the low- and high-fidelity data. In this talk, we will present two frameworks for multifidelity machine learning. The first one puts particular emphasis on operator learning, building on the Deep Operator Network (DeepONet). The second one is inspired by the concept of model reduction. We will present the main constructions along with applications to closure for multiscale systems and continual learning. Moreover, we will discuss how multifidelity approaches fit in a broader framework which includes ideas from deep learning, stochastic processes, numerical methods, computability theory and renormalization of complex systems.