Sotabase

Career

· Assistant Professor, Boston University2023–
· Visiting Faculty Researcher, Google2021–2022
· Faculty Fellow, New York University2021–
· Research Intern / Student Researcher, Google2020–2020
· Research Intern, IBM Research2019–
· Visiting Researcher, KAIST2015–2016
· PhD Student, The Johns Hopkins University2015–2021
· M.St. General Linguistics & Comparative Philology, University of Oxford2015–
· Intern Developer, NAVER Corporation2013–2014
· B.A. English Linguistics & Literature, B.A. Linguistics, Seoul National University2013–

Publications (81)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
arXiv.org · 2022
2,792
cited
What do you learn from context? Probing for sentence structure in contextualized word representations
International Conference on Learning Representations · 2019
922
cited
Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
North American Chapter of the Association for Computational Linguistics · 2023
310
cited
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation
Conference on Empirical Methods in Natural Language Processing · 2020
307
cited
Inverse Scaling: When Bigger Isn't Better
Trans. Mach. Learn. Res. · 2023
185
cited
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples
Neural Information Processing Systems · 2023
124
cited
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
Annual Meeting of the Association for Computational Linguistics · 2018
113
cited
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
International Workshop on Semantic Evaluation · 2019
113
cited
LAMBADA: Backward Chaining for Automated Reasoning in Natural Language
Annual Meeting of the Association for Computational Linguistics · 2022
94
cited
BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Information
Neural Information Processing Systems · 2023
60
cited
Implicit Discourse Relation Classification: We Need to Talk about Evaluation
Annual Meeting of the Association for Computational Linguistics · 2020
56
cited
Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering
Annual Meeting of the Association for Computational Linguistics · 2021
54
cited
(QA)^2: Question Answering with Questionable Assumptions
Annual Meeting of the Association for Computational Linguistics · 2022
49
cited
Personas as a Way to Model Truthfulness in Language Models
Conference on Empirical Methods in Natural Language Processing · 2023
41
cited
Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models
arXiv.org · 2022
34
cited
Entity Tracking in Language Models
Annual Meeting of the Association for Computational Linguistics · 2023
30
cited
Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling
arXiv.org · 2018
28
cited
CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists
Conference on Empirical Methods in Natural Language Processing · 2024
23
cited
Testing for Grammatical Category Abstraction in Neural Language Models
SCIL · 2021
22
cited
Finding Structure in One Child's Linguistic Experience.
Cognitive Sciences · 2023
20
cited
Sotabase
Najoung Kim | Researcher Profile | Sotabase | Sotabase