Sotabase

Career

· Co-founder, Humans&2025–
· Research Scientist, xAI2024–2025
· Research Intern, Microsoft Research2023–2023
· Research Intern, Blueshift @ X & Google Research2022–2022
· PhD Student, Stanford University2021–2024
· GANs Curriculum Developer, DeepLearning.AI2020–2020
· Deep Learning Engineer, Lazard2020–2021
· Intern, Argo AI2019–2019
· Intern, Uncountable2018–2018
· Software Engineer, Philometrics2016–2017
· Bachelor of Science, Stanford University2016–2020

Publications (33)

Holistic Evaluation of Language Models
Trans. Mach. Learn. Res. · 2023
1,324
cited
STaR: Bootstrapping Reasoning With Reasoning
2022
727
cited
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
arXiv.org · 2024
218
cited
Hypothesis Search: Inductive Reasoning with Language Models
International Conference on Learning Representations · 2023
152
cited
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Annual Meeting of the Association for Computational Linguistics · 2024
119
cited
Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
arXiv.org · 2023
82
cited
Parsel🦆: Algorithmic Reasoning with Language Models by Composing Decompositions
Neural Information Processing Systems · 2022
73
cited
PERSONA: A Reproducible Testbed for Pluralistic Alignment
International Conference on Computational Linguistics · 2024
50
cited
Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics
Conference on Empirical Methods in Natural Language Processing · 2022
35
cited
Evaluating the Disentanglement of Deep Generative Models through Manifold Topology
International Conference on Learning Representations · 2020
28
cited
SkyGPT: Probabilistic Ultra-short-term Solar Forecasting Using Synthetic Sky Images from Physics-constrained VideoGPT
Advances in Applied Energy · 2024
28
cited
Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels
Neural Information Processing Systems · 2024
21
cited
Just One Byte (per gradient): A Note on Low-Bandwidth Decentralized Language Model Finetuning Using Shared Randomness
arXiv.org · 2023
20
cited
Generating and Evaluating Tests for K-12 Students with Language Model Simulations: A Case Study on Sentence Reading Efficiency
Conference on Empirical Methods in Natural Language Processing · 2023
17
cited
Parsel: A Unified Natural Language Framework for Algorithmic Reasoning
arXiv.org · 2022
17
cited
CRUDE: Calibrating Regression Uncertainty Distributions Empirically
2020
15
cited
Short-Term Solar Irradiance Forecasting Using Calibrated Probabilistic Models
arXiv.org · 2020
15
cited
Certified Reasoning with Language Models
arXiv.org · 2023
13
cited
Context is Everything: Finding Meaning Statistically in Semantic Spaces
arXiv.org · 2018
5
cited
ContextRef: Evaluating Referenceless Metrics For Image Description Generation
International Conference on Learning Representations · 2023
5
cited
Sotabase
Eric Zelikman | Researcher Profile | Sotabase | Sotabase