Sotabase

Career

· Research Scientist, Google

Publications (56)

Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)
Journal of machine learning research · 2020
454
cited
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little
Conference on Empirical Methods in Natural Language Processing · 2021
278
cited
CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text
Conference on Empirical Methods in Natural Language Processing · 2019
245
cited
Ethical Challenges in Data-Driven Dialogue Systems
AAAI/ACM Conference on AI, Ethics, and Society · 2017
185
cited
A taxonomy and review of generalization research in NLP
Nature Machine Intelligence · 2022
133
cited
UnNatural Language Inference
Annual Meeting of the Association for Computational Linguistics · 2020
101
cited
Learning an Unreferenced Metric for Online Dialogue Evaluation
Annual Meeting of the Association for Computational Linguistics · 2020
86
cited
COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Prediction
arXiv.org · 2021
70
cited
Measuring Systematic Generalization in Neural Proof Generation with Transformers
Neural Information Processing Systems · 2020
67
cited
Probing Linguistic Systematicity
Annual Meeting of the Association for Computational Linguistics · 2020
60
cited
A Hierarchical Neural Attention-based Text Classifier
Conference on Empirical Methods in Natural Language Processing · 2018
50
cited
Evaluating Gender Bias in Natural Language Inference
arXiv.org · 2021
45
cited
Efficient Tool Use with Chain-of-Abstraction Reasoning
International Conference on Computational Linguistics · 2024
38
cited
ICLR Reproducibility Challenge 2019
2019
26
cited
Evaluating Logical Generalization in Graph Neural Networks
arXiv.org · 2020
24
cited
ACUEval: Fine-grained Hallucination Evaluation and Correction for Abstractive Summarization
Annual Meeting of the Association for Computational Linguistics · 2024
21
cited
Language model acceptability judgements are not always robust to context
Annual Meeting of the Association for Computational Linguistics · 2022
20
cited
The Curious Case of Absolute Position Embeddings
Conference on Empirical Methods in Natural Language Processing · 2022
20
cited
NeurIPS 2019 Reproducibility Challenge
2020
13
cited
Studying Literary Characters and Character Networks
Digital Humanities Conference · 2017
13
cited
Sotabase
Koustuv Sinha | Researcher Profile | Sotabase | Sotabase