Sotabase

Career

· PhD in Computer Science, Columbia University2020–
· Senior Applied Scientist, Amazon Web Services AI
· MS in Computer Science, Columbia University
· NVIDIA
· Visiting Student Researcher, Stanford University
· B.S. in Computer Science, Unknown Undergraduate Institution

Publications (39)

On the Opportunities and Risks of Foundation Models
arXiv.org · 2021
5,795
cited
Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
Benchmarking Large Language Models for News Summarization
Transactions of the Association for Computational Linguistics · 2023
685
cited
Whose Opinions Do Language Models Reflect?
International Conference on Machine Learning · 2023
659
cited
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
Conference on Fairness, Accountability and Transparency · 2022
436
cited
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
arXiv.org · 2024
430
cited
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
IEEE Games Entertainment Media Conference · 2021
306
cited
WikiLingua: A New Benchmark Dataset for Multilingual Abstractive Summarization
Findings · 2020
228
cited
Proving Test Set Contamination in Black Box Language Models
International Conference on Learning Representations · 2023
201
cited
A neural interlingua for multilingual machine translation
Conference on Machine Translation · 2018
127
cited
Evaluating Human-Language Model Interaction
Trans. Mach. Learn. Res. · 2022
119
cited
From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting
NEWSUM · 2023
81
cited
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization
Conference of the European Chapter of the Association for Computational Linguistics · 2023
76
cited
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization
Annual Meeting of the Association for Computational Linguistics · 2021
73
cited
PERSONA: A Reproducible Testbed for Pluralistic Alignment
International Conference on Computational Linguistics · 2024
50
cited
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Conference on Empirical Methods in Natural Language Processing · 2022
41
cited
Exploring Content Selection in Summarization of Novel Chapters
Annual Meeting of the Association for Computational Linguistics · 2020
39
cited
Spurious Correlations in Reference-Free Evaluation of Text Generation
Annual Meeting of the Association for Computational Linguistics · 2022
36
cited
The Role of Pragmatic and Discourse Context in Determining Argument Impact
Conference on Empirical Methods in Natural Language Processing · 2019
32
cited
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection
Conference on Empirical Methods in Natural Language Processing · 2022
25
cited
Sotabase
Faisal Ladhak | Researcher Profile | Sotabase | Sotabase