Sotabase

Career

· Assistant Professor, Columbia University2025–
· Visiting Researcher, Google DeepMind2024–
· Research Intern, DeepMind2022–2022
· Teaching Assistant, Co-Instructor, Stanford University2021–
· Research Intern, Google AI2020–2021
· Intern, Amazon AI2018–2018
· PhD Student, Stanford University2018–2024
· Teaching Assistant, University of Pennsylvania2018–
· Research Assistant, University of Pennsylvania2016–2018
· Research Assistant, Johns Hopkins University2015–2016
· BSE, University of Pennsylvania2014–2018

Publications (65)

On the Opportunities and Risks of Foundation Models
arXiv.org · 2021
5,795
cited
Lost in the Middle: How Language Models Use Long Contexts
Transactions of the Association for Computational Linguistics · 2023
2,811
cited
A Structural Probe for Finding Syntax in Word Representations
North American Chapter of the Association for Computational Linguistics · 2019
1,251
cited
Designing and Interpreting Probes with Control Tasks
Conference on Empirical Methods in Natural Language Processing · 2019
599
cited
Emergent linguistic structure in artificial neural networks trained by self-supervision
Proceedings of the National Academy of Sciences of the United States of America · 2020
370
cited
Methicillin resistance in Staphylococcus aureus.
The Lancet · 1970
239
cited
Finding Universal Grammatical Relations in Multilingual BERT
Annual Meeting of the Association for Computational Linguistics · 2020
166
cited
Influence of methods of collection and storage on the bacteriology of human milk.
Journal of Applied Bacteriology · 1979
124
cited
Truncation Sampling as Language Model Desmoothing
Conference on Empirical Methods in Natural Language Processing · 2022
118
cited
Man & Woman, Boy & Girl
1973
114
cited
The detection of methicillin resistance in Staphylococcus aureus.
Journal of Medical Microbiology · 1969
99
cited
XNMT: The eXtensible Neural Machine Translation Toolkit
Conference of the Association for Machine Translation in the Americas · 2018
67
cited
Organisation of bank of raw and pasteurised human milk for neonatal intensive care.
British medical journal · 1978
65
cited
Conditional probing: measuring usable information beyond a baseline
Conference on Empirical Methods in Natural Language Processing · 2021
63
cited
RNNs Can Generate Bounded Hierarchical Languages with Optimal Memory
Conference on Empirical Methods in Natural Language Processing · 2020
59
cited
The EOS Decision and Length Extrapolation
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · 2020
54
cited
Simple, Fast, Accurate Intent Classification and Slot Labeling for Goal-Oriented Dialogue Systems
SIGDIAL Conferences · 2019
40
cited
Effect of various milk feeds on numbers of Escherichia coli and Bifidobacterium in the stools of new-born infants
Journal of Hygiene · 1976
37
cited
Nasal acquisition of Staphylococcus aureus in a subdivided and mechanically ventilated ward: endemic prevalence of a single staphylococcal strain
Journal of Hygiene · 1970
35
cited
ENDEMIC STAPHYLOCOCCAL INFECTIONS IN HOSPITALS
Annals of the New York Academy of Sciences · 1974
34
cited
Sotabase
John Hewitt | Researcher Profile | Sotabase | Sotabase