Sotabase

Career

· Assistant Professor, Stanford University2019–
· Postdoctoral Researcher, Stanford University2016–2019
· PhD Student, Massachusetts Institute of Technology2011–2016
· Undergraduate Student, Harvard University2007–2011

Publications (209)

On the Opportunities and Risks of Foundation Models
arXiv.org · 2021
5,795
cited
Emergent Abilities of Large Language Models
Trans. Mach. Learn. Res. · 2022
3,200
cited
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
arXiv.org · 2019
1,471
cited
Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
Diffusion-LM Improves Controllable Text Generation
Neural Information Processing Systems · 2022
1,141
cited
s1: Simple test-time scaling
Conference on Empirical Methods in Natural Language Processing · 2025
967
cited
AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback
Neural Information Processing Systems · 2023
781
cited
Distributionally Robust Neural Networks
International Conference on Learning Representations · 2020
694
cited
Benchmarking Large Language Models for News Summarization
Transactions of the Association for Computational Linguistics · 2023
685
cited
Whose Opinions Do Language Models Reflect?
International Conference on Machine Learning · 2023
659
cited
Fairness Without Demographics in Repeated Loss Minimization
International Conference on Machine Learning · 2018
632
cited
Contrastive Decoding: Open-ended Text Generation as Optimization
Annual Meeting of the Association for Computational Linguistics · 2022
529
cited
Large Language Models Can Be Strong Differentially Private Learners
International Conference on Learning Representations · 2021
473
cited
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
Conference on Fairness, Accountability and Transparency · 2022
436
cited
Discovery of non-directional and directional pioneer transcription factors by modeling DNase profile magnitude and shape
Nature Biotechnology · 2014
432
cited
Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
2024 IEEE Security and Privacy Workshops (SPW) · 2023
335
cited
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions
International Conference on Learning Representations · 2023
333
cited
Generating Sentences by Editing Prototypes
Transactions of the Association for Computational Linguistics · 2017
320
cited
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
IEEE Games Entertainment Media Conference · 2021
306
cited
Sotabase