Simone Brugiapaglia (Concordia University)

Title: The Mathematical Foundations of Deep Learning: From Rating Impossibility to Practical Existence Theorems.

Abstract: Deep learning is having a profound impact on industry and scientific research. Yet, while this paradigm continues to show impressive performance in a wide variety of applications, its mathematical foundations are far from being well established. In this talk, I will present recent developments in this area by illustrating two case studies.

First, motivated by applications in cognitive science, I will present “rating impossibility" theorems. They identify frameworks where deep learning is provably unable to generalize outside the training set for the seemingly simple task of learning identity effects, i.e. classifying whether pairs of objects are identical or not.Second, motivated by applications in scientific computing, I will illustrate “practical existence" theorems. They combine universal approximation results for deep neural networks with compressed sensing and high-dimensional polynomial approximation theory. As a result, they yield sufficient conditions on the network architecture, the training strategy, and the number of samples able to guarantee accurate approximation of smooth functions of many variables.Time permitting, I will also discuss work in progress and open questions.To receive the announcements with the Zoom link, please subscribe once to the lists of your choice

Web site : http://crm.umontreal.ca/colloque-sciences-mathematiques-quebec/index.html#csmq

Hybride - CRM, Salle / Room 5340, Pavillon André Aisenstadt / Zoom (voir survol/ see overview)