Sotabase

Career

· Founding Engineer, Coursera
· Senior Software Engineer, Google
· Bachelor of Science, Computer Science, Stanford University
· Intern, Stanford University
· Master of Science, Computer Science, Stanford University
· Software Engineer, Stanford University

Publications (60)

Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
Holistic Evaluation of Text-To-Image Models
Neural Information Processing Systems · 2023
174
cited
Introducing v0.5 of the AI Safety Benchmark from MLCommons
arXiv.org · 2024
55
cited
AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policies
AGI - Artificial General Intelligence - Robotics - Safety & Alignment · 2024
51
cited
MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
arXiv.org · 2025
47
cited
VHELM: A Holistic Evaluation of Vision Language Models
Neural Information Processing Systems · 2024
45
cited
Language model developers should report train-test overlap
arXiv.org · 2024
18
cited
AutoBencher: Towards Declarative Benchmark Construction
International Conference on Learning Representations · 2024
17
cited
Using Benchmarking Infrastructure to Evaluate LLM Performance on CS Concept Inventories: Challenges, Opportunities, and Critiques
International Computing Education Research Workshop · 2024
17
cited
AIR-BENCH 2024: A Safety Benchmark based on Regulation and Policies Specified Risk Categories
International Conference on Learning Representations · 2025
16
cited
Image2Struct: Benchmarking Structure Extraction for Vision-Language Models
Neural Information Processing Systems · 2024
16
cited
AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
arXiv.org · 2025
15
cited
The Singapore Consensus on Global AI Safety Research Priorities
Robotics · 2025
10
cited
AHELM: A Holistic Evaluation of Audio-Language Models
arXiv.org · 2025
9
cited
The Mighty ToRR: A Benchmark for Table Reasoning and Robustness
arXiv.org · 2025
8
cited
Evaluating Large Language Models with Enterprise Benchmarks
North American Chapter of the Association for Computational Linguistics · 2025
7
cited
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models
Annual Meeting of the Association for Computational Linguistics · 2025
6
cited
Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
arXiv.org · 2025
5
cited
Holistic evaluation of large language models for medical tasks with MedHELM.
Nature Medicine · 2026
1
cited
LLMs Judging LLMs: A Simplex Perspective
2025
1
cited
Sotabase
Yifan Mai | Researcher Profile | Sotabase | Sotabase