Sotabase

Career

· Dieter Schwarz Foundation Professor and Senior Fellow, Stanford University2025–
· Senior Director, Allen Institute for AI2018–2025
· Senior Director, Allen Institute for AI (AI2)2018–
· Wissner-Slivka Professor, University of Washington2014–2025
· Assistant Professor, Stony Brook University2010–2014
· PhD in Computer Science, Cornell University2005–2010
· Software Design Engineer, Microsoft Corporation2000–2003
· BS in Computer Engineering, Seoul National University1995–1999
· Consultant, NVIDIA
· Distinguished Scientist of Language and Cognition Research, NVIDIA
· Bachelor of Science in Computer Science and Engineering, Seoul National University

Publications (238)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
Findings · 2020
1,506
cited
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Annual Meeting of the Association for Computational Linguistics · 2011
1,465
cited
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks
Conference on Empirical Methods in Natural Language Processing · 2022
1,026
cited
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction
Annual Meeting of the Association for Computational Linguistics · 2019
992
cited
The Risk of Racial Bias in Hate Speech Detection
Annual Meeting of the Association for Computational Linguistics · 2019
965
cited
QuAC: Question Answering in Context
Conference on Empirical Methods in Natural Language Processing · 2018
883
cited
Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
Conference on Empirical Methods in Natural Language Processing · 2017
870
cited
MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms
North American Chapter of the Association for Computational Linguistics · 2019
766
cited
Social Bias Frames: Reasoning about Social and Power Implications of Language
Annual Meeting of the Association for Computational Linguistics · 2019
575
cited
Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting
International Conference on Learning Representations · 2023
573
cited
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
Conference on Empirical Methods in Natural Language Processing · 2020
529
cited
Faith and Fate: Limits of Transformers on Compositionality
Neural Information Processing Systems · 2023
512
cited
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
Annual Meeting of the Association for Computational Linguistics · 2021
455
cited
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs
AAAI Conference on Artificial Intelligence · 2020
444
cited
Generated Knowledge Prompting for Commonsense Reasoning
Annual Meeting of the Association for Computational Linguistics · 2021
375
cited
RewardBench: Evaluating Reward Models for Language Modeling
arXiv.org · 2024
352
cited
Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection
North American Chapter of the Association for Computational Linguistics · 2021
339
cited
Neural AMR: Sequence-to-Sequence Models for Parsing and Generation
Annual Meeting of the Association for Computational Linguistics · 2017
316
cited
Deep Communicating Agents for Abstractive Summarization
North American Chapter of the Association for Computational Linguistics · 2018
315
cited
Sotabase