Sotabase

Career

· Research Scientist, Facebook2020–
· Associate Professor of Applied Physics, Stanford University2020–
· Visiting Research Professor, Google2017–2020
· Assistant Professor of Applied Physics, Stanford University2012–2019
· Postdoctoral Researcher, University of California, San Francisco (UCSF)2004–2012
· Ph.D. in Theoretical Physics, University of California, Berkeley1998–2004
· M.Eng. in Electrical Engineering and Computer Science, Massachusetts Institute of Technology (MIT)1993–1998

Publications (356)

Deep Unsupervised Learning using Nonequilibrium Thermodynamics
International Conference on Machine Learning · 2015
9,070
cited
Continual Learning Through Synaptic Intelligence
International Conference on Machine Learning · 2017
3,049
cited
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
International Conference on Learning Representations · 2013
1,992
cited
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Neural Information Processing Systems · 2014
1,472
cited
Deep Knowledge Tracing
Neural Information Processing Systems · 2015
1,410
cited
Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
A deep learning framework for neuroscience
Nature Neuroscience · 2019
930
cited
On the Expressive Power of Deep Neural Networks
International Conference on Machine Learning · 2016
856
cited
Pruning neural networks without any data by iteratively conserving synaptic flow
Neural Information Processing Systems · 2020
769
cited
SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks
Neural Computation · 2017
649
cited
Exponential expressivity in deep neural networks through transient chaos
Neural Information Processing Systems · 2016
643
cited
Deep Learning on a Data Diet: Finding Important Examples Early in Training
Neural Information Processing Systems · 2021
599
cited
Beyond neural scaling laws: beating power law scaling via data pruning
Neural Information Processing Systems · 2022
555
cited
Cortical layer–specific critical dynamics triggering perception
Science · 2019
547
cited
Deep Information Propagation
International Conference on Learning Representations · 2016
403
cited
On simplicity and complexity in the brave new world of large-scale neuroscience
Current Opinion in Neurobiology · 2015
384
cited
Embodied intelligence via learning and evolution
Nature Communications · 2021
355
cited
Understanding self-supervised Learning Dynamics without Contrastive Pairs
International Conference on Machine Learning · 2021
328
cited
Memory traces in dynamical systems
Proceedings of the National Academy of Sciences of the United States of America · 2008
315
cited
A theory of multineuronal dimensionality, dynamics and measurement
bioRxiv · 2017
313
cited
Sotabase
Surya Ganguli | Researcher Profile | Sotabase | Sotabase