Sotabase

Career

· Assistant Professor, UC Berkeley2023–
· Young Investigator, Mosaic Team, Allen Institute for Artificial Intelligence (AI2)2022–2023
· Research Intern, Google2019–
· Research Assistant, Cornell University2017–2022
· PhD in Computer Science, Cornell University2016–2022
· Intern, Google2015–
· Research Assistant, Ohio State University2015–2016
· Software Development Intern, Kosada, Inc.2013–
· BS, Computer Science and Engineering with Honors, summa cum laude, Ohio State University2012–2016
· Professor, Berkeley

Publications (0)

A Corpus for Reasoning about Natural Language Grounded in Photographs
Annual Meeting of the Association for Computational Linguistics · 2018
682
cited
Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting
International Conference on Learning Representations · 2023
573
cited
TOUCHDOWN: Natural Language Navigation and Spatial Reasoning in Visual Street Environments
Computer Vision and Pattern Recognition · 2018
441
cited
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Neural Information Processing Systems · 2023
421
cited
A Corpus of Natural Language for Visual Reasoning
Annual Meeting of the Association for Computational Linguistics · 2017
268
cited
Training Software Engineering Agents and Verifiers with SWE-Gym
International Conference on Machine Learning · 2024
146
cited
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
Neural Information Processing Systems · 2024
142
cited
We're Afraid Language Models Aren't Modeling Ambiguity
Conference on Empirical Methods in Natural Language Processing · 2023
140
cited
What's In My Big Data?
arXiv.org · 2023
123
cited
Minding Language Models’ (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker
Annual Meeting of the Association for Computational Linguistics · 2023
107
cited
Do Embodied Agents Dream of Pixelated Sheep?: Embodied Decision Making using Language Guided World Modelling
International Conference on Machine Learning · 2023
106
cited
Autonomous Evaluation and Refinement of Digital Agents
arXiv.org · 2024
102
cited
Exploring Unexplored Generalization Challenges for Cross-Database Semantic Parsing
Annual Meeting of the Association for Computational Linguistics · 2020
99
cited
Executing Instructions in Situated Collaborative Interactions
Conference on Empirical Methods in Natural Language Processing · 2019
94
cited
Learning to Map Context-Dependent Sentences to Executable Formal Queries
North American Chapter of the Association for Computational Linguistics · 2018
91
cited
Abstract Visual Reasoning with Tangram Shapes
Conference on Empirical Methods in Natural Language Processing · 2022
53
cited
Situated Mapping of Sequential Instructions to Actions with Single-step Reward Observation
Annual Meeting of the Association for Computational Linguistics · 2018
33
cited
Continual Learning for Grounded Instruction Generation by Observing Human Following Behavior
Transactions of the Association for Computational Linguistics · 2021
28
cited
Continual Learning for Instruction Following from Realtime Feedback
Neural Information Processing Systems · 2022
20
cited
Neural Semantic Parsing
Annual Meeting of the Association for Computational Linguistics · 2018
20
cited
Sotabase