Sotabase

Career

· Vice Provost For Artificial Intelligence, University of Washington2025–
· Senior Director Of NLP Research, Allen Institute for AI (AI2)2018–
· Professor, University of Washington2015–
· Associate Professor, Carnegie Mellon University2006–2015

Publications (427)

Self-Instruct: Aligning Language Models with Self-Generated Instructions
Annual Meeting of the Association for Computational Linguistics · 2022
2,879
cited
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Annual Meeting of the Association for Computational Linguistics · 2020
2,779
cited
From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
International Conference on Web and Social Media · 2010
2,136
cited
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
Findings · 2020
1,506
cited
Green AI
2019
1,434
cited
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Annual Meeting of the Association for Computational Linguistics · 2016
1,375
cited
Annotation Artifacts in Natural Language Inference Data
North American Chapter of the Association for Computational Linguistics · 2018
1,235
cited
Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
Annual Meeting of the Association for Computational Linguistics · 2010
1,118
cited
A Simple, Fast, and Effective Reparameterization of IBM Model 2
North American Chapter of the Association for Computational Linguistics · 2013
1,101
cited
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
International Conference on Learning Representations · 2021
1,043
cited
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks
Conference on Empirical Methods in Natural Language Processing · 2022
1,026
cited
Measuring and Narrowing the Compositionality Gap in Language Models
Conference on Empirical Methods in Natural Language Processing · 2022
990
cited
The Risk of Racial Bias in Hate Speech Detection
Annual Meeting of the Association for Computational Linguistics · 2019
965
cited
Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters
North American Chapter of the Association for Computational Linguistics · 2013
821
cited
Transition-Based Dependency Parsing with Stack Long Short-Term Memory
Annual Meeting of the Association for Computational Linguistics · 2015
815
cited
Linguistic Knowledge and Transferability of Contextual Representations
North American Chapter of the Association for Computational Linguistics · 2019
794
cited
Is Attention Interpretable?
Annual Meeting of the Association for Computational Linguistics · 2019
765
cited
A Latent Variable Model for Geographic Lexical Variation
Conference on Empirical Methods in Natural Language Processing · 2010
723
cited
Knowledge Enhanced Contextual Word Representations
Conference on Empirical Methods in Natural Language Processing · 2019
715
cited
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
arXiv.org · 2020
686
cited
Sotabase