Sotabase

Career

· Member Of Technical Staff, Contextual AI2023–2023
· Doctoral Researcher, Stanford Artificial Intelligence Laboratory (SAIL)2023–
· Research Engineer, Hugging Face2022–2023
· Research Associate, Facebook Fundamental AI Research (FAIR), Meta2020–2022
· Research Associate, Computational Psycholinguistics Group, MIT Brain and Cognitive Sciences2019–2020
· Graduate Research Assistant, Genesis Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL)2019–2019
· Graduate Research, Genesis Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL)2019–2019
· Remote Affiliate, Computer Vision Group, NASA Jet Propulsion Laboratory2018–2018
· MIT EECS Undergraduate Research And Innovation Scholar, Genesis Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL)2017–2018
· Undergraduate Researcher, Robot Locomotion Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL)2017–2017
· Undergraduate Researcher, Genesis Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL)2016–2019

Publications (32)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
arXiv.org · 2022
2,792
cited
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
Computer Vision and Pattern Recognition · 2022
535
cited
Dynabench: Rethinking Benchmarking in NLP
North American Chapter of the Association for Computational Linguistics · 2021
472
cited
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection
Annual Meeting of the Association for Computational Linguistics · 2021
320
cited
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Neural Information Processing Systems · 2023
201
cited
DataPerf: Benchmarks for Data-Centric AI Development
Neural Information Processing Systems · 2022
129
cited
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation
Conference on Empirical Methods in Natural Language Processing · 2021
111
cited
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate
North American Chapter of the Association for Computational Linguistics · 2021
75
cited
Towards Language Models That Can See: Computer Vision Through the LENS of Natural Language
arXiv.org · 2023
65
cited
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking
Neural Information Processing Systems · 2021
64
cited
ANLIzing the Adversarial Natural Language Inference Dataset
SCIL · 2020
49
cited
Improving Pretraining Data Using Perplexity Correlations
International Conference on Learning Representations · 2024
38
cited
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements
Conference on Empirical Methods in Natural Language Processing · 2022
35
cited
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants
North American Chapter of the Association for Computational Linguistics · 2021
35
cited
Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation
Conference on Machine Translation · 2021
29
cited
Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · 2020
19
cited
Measuring Data
arXiv.org · 2022
19
cited
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks
Annual Meeting of the Association for Computational Linguistics · 2022
15
cited
Rover Relocalization for Mars Sample Return by Virtual Template Synthesis and Matching
IEEE Robotics and Automation Letters · 2021
11
cited
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation
Annual Meeting of the Association for Computational Linguistics · 2024
10
cited
Sotabase
Tristan Thrush | Researcher Profile | Sotabase | Sotabase