Monday, Jan 07, 2019 |
|
Session Chair: Chiara Cammarota (King's College)
|
| 8:50am |
Lars Bildsten (KITP Director) |
Welcome[Podcast][Aud][Cam] |
| 9:00am |
Sasha Rakhlin (MIT) |
TUTORIAL: Generalization and Overfitting -- Basic Concepts and Open Questions[Slides][Podcast][Aud][Cam] |
| 10:30am |
|
| 11:00am |
Ricardo Zecchina (Polito) |
On the Existence and on the Role of Wide Flat Minima in Neural Networks Models[Podcast][Aud][Cam] |
| 11:45am |
Yan Fyodorov
(King's College) |
On Reconstructing Nonlinearly Encrypted Signals Corrupted by Noise[Slides][Podcast][Aud][Cam] |
| 12:30pm |
|
| 2:00pm |
|
Tuesday, Jan 08, 2019 |
|
Session Chair: Giulio Biroli (ENS)
|
| 9:00am |
Marc Mézard (ENS-Paris) |
TUTORIAL: Disordered systems in Physics, Information Theory and Computer Science[Slides][Podcast][Aud][Cam] |
| 10:30am |
|
| 11:00am |
Michael Jordan (Berkeley) |
On Gradient-Based Optimization and Diffusions in High Dimensions[Slides][Podcast][Aud][Cam] |
| 12:30pm |
|
|
Session Chair: Andrea Montanari (Stanford)
|
| 2:00pm |
Sho Yaida (FAIR) |
Glassy Slowdown and Amorphous Order[Slides][Podcast][Aud][Cam] |
| 2:45pm |
Surya Ganguli (Stanford) |
An Analytic Theory for the Nonlinear Dynamics of Generalization in Deep Linear Network[Podcast][Aud][Cam] |
| 3:30pm |
|
| 4:00pm |
Lenka Zdeborova
(CEA-Saclay) |
Algorithmic Barriers in High-dimensional Non-convex Landscapes[Slides][Podcast][Aud][Cam] |
| 4:45pm |
Vardan Papyan (Stanford) |
Measuring the Spectrum of Deepnet Hessians[Slides][Podcast][Aud][Cam] |
| 5:30pm |
|
| 6:00pm |
|
| 8:00pm |
|
Wednesday, Jan 09, 2019 |
|
Session Chair: Chiara Cammarota (King's College)
|
| 9:00am |
Nathan Srebro (Chicago) |
TUTORIAL: Optimization Methods from a Machine Learning Perspective[Podcast][Aud][Cam] |
| 10:30am |
|
| 11:00am |
Yue Lu (Harvard) |
Spectral methods for nonconvex estimation and the landscapes of MIMO detection[Podcast][Aud][Cam] |
| 11:45am |
Nike Sun (MIT) |
Capacity Lower Bound for the Ising Perceptron[Podcast][Aud][Cam] |
| 12:30pm |
Maggie Sherriffs (KITP) |
Announcement-Follow-on program[Podcast][Aud][Cam] |
| 12:35pm |
|
|
Session Chair: Andrea Montanari (Stanford)
|
| 2:00pm |
Po-Ling Loh (Wisconsin) |
The not-so-rough Landscape of Nonconvex M-estimators[Slides][Podcast][Aud][Cam] |
| 2:45pm |
Antonio Auffinger
(Northwestern) |
Energy Landscape of Mean Field Spin Glasses[Slides][Podcast][Aud][Cam] |
| 3:30pm |
|
| 4:00pm |
Matthieu Wyart (EPFL) |
Effect of a Jamming Transition on Loss Landscape and Generalization in Deep Learning |
| 4:45pm |
Yuxin Chen (Princeton) |
Gradient descent with random initialization: Fast global convergence of Nonconvex Phase Retrieval[Slides][Podcast][Aud][Cam] |
| 5:30pm |
All Participants |
Group discussion about open questions |
| 6:00pm |
|
Thursday, Jan 10, 2019 |
|
Session Chair: Patrick Charbonneau (Duke)
|
| 9:00am |
Leticia Cugliandolo
(Sorbonne U) |
TUTORIAL: Dynamics in High Dimensional Landscapes[Slides][Podcast][Aud][Cam] |
| 10:30am |
|
| 11:00am |
Daniel Fisher (Stanford) |
Evolutionary and Ecological Dynamics: Landscapes and Beyond |
| 11:45am |
Deanna Needell (UCLA) |
Iterative Projective Approach for Linear Systems with Link to Deep Learning[Slides][Podcast][Aud][Cam] |
| 12:30pm |
|
|
Session Chair: Lenka Zdeborova (CEA)
|
| 2:00pm |
Federico Ricci-Tersenghi
(La Sapienza) |
Unexpected Behavior in the off Equilibrium Dynamics of Spin Glasses[Slides][Podcast][Aud][Cam] |
| 2:45pm |
Gerard Benarous (NYU) |
Denoising Simple Tensors[Podcast][Aud][Cam] |
| 3:30pm |
|
| 3:45pm |
David Wales (Cambridge) |
Energy Landscapes: from Molecules and Nanodevices to Machine Learning[Slides][Podcast][Aud][Cam] |
| 4:30pm |
Amir Dembo (Stanford) |
Dynamics for spherical spin glasses: disorder dependent initial conditions[Slides][Podcast][Aud][Cam] |
| 5:15pm |
Nicolas Brunel (Duke) |
Dynamics of Neural Networks with Learning Rules Inferred from Data[Slides][Aud][Cam] |
| 6:00pm |
|
| 6:00pm |
|
| 8:00pm |
|
Friday, Jan 11, 2019 |
|
Session Chair: Leticia Cugliandolo (Sorbonne U)
|
| 9:00am |
Ankur Moitra (MIT) |
TUTORIAL Sum-of-Squares, with a View Towards Average-case Complexity[Slides][Podcast][Aud][Cam] |
| 10:30am |
|
| 11:00am |
Adel Javanmard (USC) |
Analysis of a Two-Layer Neural Network via Displacement Convexity[Slides][Podcast][Aud][Cam] |
| 11:45am |
Roberto Oliveira (IMPA) |
Local Optima of the Sherrington-Kirkpatrick Hamiltonian[Podcast][Aud][Cam] |
| 12:30pm |
|
| 2:00pm |
|
