Sotabase

Career

· PhD in Computer Science, Stanford University2023–
· MS in Computer Science, Stanford University2022–
· Teaching Assistant for CS224N: Natural Language Processing with Deep Learning, Stanford University2021–
· Writer, The Stanford Daily2019–

Publications (0)

Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Annual Meeting of the Association for Computational Linguistics · 2024
119
cited
GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
arXiv.org · 2025
66
cited
Ecosystem Graphs: The Social Footprint of Foundation Models
arXiv.org · 2023
43
cited
Neural Generation Meets Real People: Towards Emotionally Engaging Mixed-Initiative Conversations
arXiv.org · 2020
42
cited
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together
Conference on Empirical Methods in Natural Language Processing · 2024
38
cited
Building Efficient and Effective OpenQA Systems for Low-Resource Languages
Knowledge-Based Systems · 2024
9
cited
Neural Generation Meets Real People: Building a Social, Informative Open-Domain Dialogue Agent
SIGDIAL Conferences · 2022
7
cited
Large-Scale Quantitative Evaluation of Dialogue Agents’ Response Strategies against Offensive Users
SIGDIAL Conferences · 2021
6
cited
Ecosystem Graphs: Documenting the Foundation Model Supply Chain
AAAI/ACM Conference on AI, Ethics, and Society · 2024
4
cited
Multi-module GRPO: Composing Policy Gradients and Prompt Optimization for Language Model Programs
arXiv.org · 2025
2
cited
ChronoBias : A Benchmark for Evaluating Time-conditional Group Bias in the Time-sensitive Knowledge of Large Language Models
LiteLMGuard : Seamless and Lightweight On-Device Guardrails for Small Language Models against Quantization Vulnerabilities
Music Recommendation for Podcast Scripts: Detecting Emotion from Text
2020
Sotabase