Sotabase

Career

· PhD in Computer Science, Stanford University2024–
· Researcher, Allen Institute for Artificial Intelligence (AI2)2023–
· Researcher, Contextual AI2023–
· Researcher, Hugging Face2022–2023
· Bachelor's Degree in Finance & Computer Science, Peking University2018–2022
· Pre-college Program, Harvard University
· Intern/Researcher (implied), Meta

Publications (87)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
arXiv.org · 2022
2,792
cited
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
StarCoder: may the source be with you!
Trans. Mach. Learn. Res. · 2023
1,079
cited
s1: Simple test-time scaling
Conference on Empirical Methods in Natural Language Processing · 2025
967
cited
KTO: Model Alignment as Prospect Theoretic Optimization
International Conference on Machine Learning · 2024
856
cited
C-Pack: Packaged Resources To Advance General Chinese Embedding
arXiv.org · 2023
769
cited
MTEB: Massive Text Embedding Benchmark
Conference of the European Chapter of the Association for Computational Linguistics · 2022
702
cited
OLMo: Accelerating the Science of Language Models
Annual Meeting of the Association for Computational Linguistics · 2024
563
cited
StarCoder 2 and The Stack v2: The Next Generation
arXiv.org · 2024
561
cited
Crosslingual Generalization through Multitask Finetuning
Annual Meeting of the Association for Computational Linguistics · 2023
556
cited
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
International Conference on Learning Representations · 2024
403
cited
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Annual Meeting of the Association for Computational Linguistics · 2024
399
cited
C-Pack: Packed Resources For General Chinese Embeddings
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · 2023
396
cited
OpenHands: An Open Platform for AI Software Developers as Generalist Agents
International Conference on Learning Representations · 2024
374
cited
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
arXiv.org · 2024
356
cited
Scaling Data-Constrained Language Models
Neural Information Processing Systems · 2023
332
cited
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model
Annual Meeting of the Association for Computational Linguistics · 2024
330
cited
SGPT: GPT Sentence Embeddings for Semantic Search
arXiv.org · 2022
244
cited
DataComp-LM: In search of the next generation of training sets for language models
Neural Information Processing Systems · 2024
238
cited
SantaCoder: don't reach for the stars!
arXiv.org · 2023
228
cited
Sotabase
Niklas Muennighoff | Researcher Profile | Sotabase | Sotabase