Sotabase

Career

· Associate Professor of Linguistics and Data Science, New York University2023–
· Research Scientist, Google2021–
· Assistant Professor of Linguistics and Data Science, New York University2020–2023
· Assistant Professor, Johns Hopkins University2017–2020
· Postdoctoral Researcher, Ecole Normale Supérieure2015–2017
· Postdoctoral Researcher, Ecole Normale Supérieure, Paris2015–2017
· Ph.D., Linguistics, New York University2010–2015
· M.A., Linguistics, Tel Aviv University2008–2010
· B.Sc., Mathematics & Linguistics, Tel Aviv University2005–2010

Publications (239)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
Annual Meeting of the Association for Computational Linguistics · 2019
1,341
cited
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
Transactions of the Association for Computational Linguistics · 2016
960
cited
Colorless Green Recurrent Networks Dream Hierarchically
North American Chapter of the Association for Computational Linguistics · 2018
530
cited
Targeted Syntactic Evaluation of Language Models
Conference on Empirical Methods in Natural Language Processing · 2018
448
cited
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation
Conference on Empirical Methods in Natural Language Processing · 2020
307
cited
Syntactic Structure from Deep Learning
Annual Review of Linguistics · 2020
213
cited
How Can We Accelerate Progress Towards Human-like Linguistic Generalization?
Annual Meeting of the Association for Computational Linguistics · 2020
207
cited
Syntactic Data Augmentation Increases Robustness to Inference Heuristics
Annual Meeting of the Association for Computational Linguistics · 2020
193
cited
BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · 2019
158
cited
Issues in evaluating semantic spaces using word analogies
RepEval@ACL · 2016
158
cited
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Annual Meeting of the Association for Computational Linguistics · 2021
139
cited
Uncertainty and Expectation in Sentence Processing: Evidence From Subcategorization Distributions
Cognitive Sciences · 2016
120
cited
Does Syntax Need to Grow on Trees? Sources of Hierarchical Inductive Bias in Sequence-to-Sequence Networks
Transactions of the Association for Computational Linguistics · 2020
117
cited
Human few-shot learning of compositional instructions
Annual Meeting of the Cognitive Science Society · 2019
116
cited
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
International Workshop on Semantic Evaluation · 2019
113
cited
The MultiBERTs: BERT Reproductions for Robustness Analysis
International Conference on Learning Representations · 2021
100
cited
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Transactions of the Association for Computational Linguistics · 2021
93
cited
Proceedings of the 2018 EMNLP Workshop BlackboxNLP : Analyzing and Interpreting Neural Networks for NLP
2018
90
cited
Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks
Annual Meeting of the Cognitive Science Society · 2018
85
cited
Sotabase