Sotabase

Career

· Research Scientist, Meta2025–
· Ph.D. student in Computer Science, University of California, Berkeley2017–

Publications (68)

Scaling Instruction-Finetuned Language Models
Journal of machine learning research · 2022
3,860
cited
Competition-level code generation with AlphaCode
Science · 2022
1,918
cited
Large Language Models Can Be Easily Distracted by Irrelevant Context
International Conference on Machine Learning · 2023
848
cited
Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defenses
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020
360
cited
Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong
arXiv.org · 2017
242
cited
Adversarial Example Defense: Ensembles of Weak Defenses are not Strong
Workshop on Offensive Technologies · 2017
206
cited
Vulnerability Detection with Code Language Models: How Far are We?
International Conference on Software Engineering · 2024
163
cited
Large Language Models as Analogical Reasoners
International Conference on Learning Representations · 2023
136
cited
Chain of Code: Reasoning with a Language Model-Augmented Code Emulator
International Conference on Machine Learning · 2023
133
cited
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques
arXiv.org · 2021
123
cited
LEGO: Latent Execution-Guided Reasoning for Multi-Hop Question Answering on Knowledge Graphs
International Conference on Machine Learning · 2021
93
cited
Fooling Vision and Language Models Despite Localization and Attention Mechanism
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · 2017
85
cited
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
International Conference on Learning Representations · 2023
81
cited
SpreadsheetCoder: Formula Prediction from Semi-structured Context
International Conference on Machine Learning · 2021
61
cited
Synthesize, Execute and Debug: Learning to Repair for Neural Program Synthesis
Neural Information Processing Systems · 2020
60
cited
SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs
Knowledge Discovery and Data Mining · 2021
48
cited
Can you fool AI with adversarial examples on a visual Turing test?
arXiv.org · 2017
41
cited
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
arXiv.org · 2023
38
cited
Many-server Gaussian limits for overloaded non-Markovian queues with customer abandonment
Queueing Syst. Theory Appl. · 2018
32
cited
An Online Learning Approach to Dynamic Pricing and Capacity Sizing in Service Systems
Operational Research · 2020
29
cited
Sotabase