Sotabase

Career

· Research Scientist, Facebook AI2018–
· Research Lead, Allen Institute for AI (AI2)2017–2018
· Professor, University of Washington (Current)2010–
· Postdoctoral Researcher, The University of Edinburgh2009–2010
· Doctor of Philosophy - PhD, Computer Science, Massachusetts Institute of Technology2001–2009
· Bachelor of Science - BS, Mathematics and Computer Science, North Carolina State University1996–2000

Publications (335)

RoBERTa: A Robustly Optimized BERT Pretraining Approach
arXiv.org · 2019
28,249
cited
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
Annual Meeting of the Association for Computational Linguistics · 2019
12,207
cited
Deep Contextualized Word Representations
North American Chapter of the Association for Computational Linguistics · 2018
12,012
cited
Unsupervised Cross-lingual Representation Learning at Scale
Annual Meeting of the Association for Computational Linguistics · 2019
7,787
cited
OPT: Open Pre-trained Transformer Language Models
arXiv.org · 2022
4,454
cited
QLoRA: Efficient Finetuning of Quantized LLMs
Neural Information Processing Systems · 2023
3,833
cited
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Annual Meeting of the Association for Computational Linguistics · 2017
3,412
cited
Toolformer: Language Models Can Teach Themselves to Use Tools
Neural Information Processing Systems · 2023
2,831
cited
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Transactions of the Association for Computational Linguistics · 2019
2,108
cited
Multilingual Denoising Pre-training for Neural Machine Translation
Transactions of the Association for Computational Linguistics · 2020
1,999
cited
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Conference on Empirical Methods in Natural Language Processing · 2022
1,843
cited
AllenNLP: A Deep Semantic Natural Language Processing Platform
arXiv.org · 2018
1,315
cited
LIMA: Less Is More for Alignment
Neural Information Processing Systems · 2023
1,157
cited
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Annual Meeting of the Association for Computational Linguistics · 2011
1,049
cited
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Conference on Empirical Methods in Natural Language Processing · 2023
1,043
cited
Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
Conference on Uncertainty in Artificial Intelligence · 2005
986
cited
Generalization through Memorization: Nearest Neighbor Language Models
International Conference on Learning Representations · 2019
985
cited
s1: Simple test-time scaling
Conference on Empirical Methods in Natural Language Processing · 2025
967
cited
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
Computer Vision and Pattern Recognition · 2019
956
cited
End-to-end Neural Coreference Resolution
Conference on Empirical Methods in Natural Language Processing · 2017
939
cited
Sotabase