Sotabase

Career

· Senior Fellow and SVP for Google AI, Google1999–
· Chief Scientist, Google DeepMind and Google Research1999–
· Researcher, DEC/Compaq Western Research Laboratory1996–1999
· PhD in Computer Science, University of Washington1992–1996
· B.S. in Computer Science and Engineering, University of Minnesota1986–1990

Publications (44)

PaLM: Scaling Language Modeling with Pathways
Journal of machine learning research · 2022
7,570
cited
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
International Conference on Learning Representations · 2017
3,866
cited
Scaling Instruction-Finetuned Language Models
Journal of machine learning research · 2022
3,860
cited
A guide to deep learning in healthcare
Nature Medicine · 2019
3,569
cited
Emergent Abilities of Large Language Models
Trans. Mach. Learn. Res. · 2022
3,200
cited
Efficient Neural Architecture Search via Parameter Sharing
International Conference on Machine Learning · 2018
2,935
cited
Deep learning-enabled medical computer vision
npj Digital Medicine · 2021
1,027
cited
Carbon Emissions and Large Neural Network Training
arXiv.org · 2021
926
cited
A graph placement methodology for fast chip design
Nature · 2021
675
cited
Efficiently Scaling Transformer Inference
Conference on Machine Learning and Systems · 2022
500
cited
Device Placement Optimization with Reinforcement Learning
International Conference on Machine Learning · 2017
475
cited
The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
Computer · 2022
357
cited
ST-MoE: Designing Stable and Transferable Sparse Expert Models
2022
312
cited
Chip Placement with Deep Reinforcement Learning
arXiv.org · 2020
241
cited
A Review of Sparse Expert Models in Deep Learning
arXiv.org · 2022
196
cited
A New Golden Age in Computer Architecture: Empowering the Machine-Learning Revolution
IEEE Micro · 2018
174
cited
A Hierarchical Model for Device Placement
International Conference on Learning Representations · 2018
163
cited
Accelerating Deep Learning by Focusing on the Biggest Losers
arXiv.org · 2019
142
cited
Dynamic control flow in large-scale machine learning
European Conference on Computer Systems · 2018
112
cited
Designing Effective Sparse Expert Models
IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · 2022
103
cited
Sotabase
Jeff Dean | Researcher Profile | Sotabase | Sotabase