Sotabase

Career

· Quantitative Research Intern, Citadel2024–
· Research Intern, Netflix2024–
· Research Scientist, OpenAI2024–
· Research Intern, Google DeepMind2023–2024
· Algorithm Developer Intern, Hudson River Trading2023–
· Graduate Course Assistant + Senior Section Leader, Stanford University2021–2024
· Research Assistant, Stanford ML Group (AI for Healthcare Bootcamp), Stanford University2021–2022
· Research Assistant, Stanford NLP Group, Stanford University2021–2024
· MS/BS Student, Computer Science and Music, Stanford University2020–2024

Publications (15)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Annual Meeting of the Association for Computational Linguistics · 2024
119
cited
Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance
arXiv.org · 2024
14
cited
Dialogue Distillery: Crafting Interpolable, Interpretable, and Introspectable Dialogue from LLMs
2023
5
cited
RedwoodNLP at SemEval-2021 Task 7: Ensembled Pretrained and Lightweight Models for Humor Detection
International Workshop on Semantic Evaluation · 2021
1
cited
Testing the Boundaries of LLMs: Dialectal and Language-Variety Tasks
COLING Workshops · 2025
1
cited
ChronoBias : A Benchmark for Evaluating Time-conditional Group Bias in the Time-sensitive Knowledge of Large Language Models
GLARE: Generative Left-to-right AdversaRial Examples
EVAL4NLP · 2022
Stanford MLab at SemEval 2022 Task 7: Tree- and Transformer-Based Methods for Clarification Plausibility
International Workshop on Semantic Evaluation · 2022
Sotabase
Ryan Chi | Researcher Profile | Sotabase | Sotabase