ML Seminar: The Role of Regularization in Overparameterized Neural Networks
Monday, October 19, 2020
R. Srikant (University of Illinois at Urbana-Champaign)
Date: Friday, October 16, 2020
Time: 11:00 AM – 12:00 PM (CDT; UTC -5)
Title: The Role of Regularization in Overparameterized Neural Networks
Abstract: Overparameterized neural networks have proved to be remarkably successful in many complex tasks such as image classification and deep reinforcement learning. In this talk, we will consider the role of explicit regularization in training overparameterized neural networks. Specifically, we consider ReLU networks and show that the landscape of commonly used regularized loss functions have the property that every local minimum has good memorization and regularization performance. Joint work with Shiyu Liang and Ruoyu Sun.