Sotabase

Career

· Researcher, MIT Research Laboratory of Electronics (RLE)2024–
· B.S. Aerospace Engineering, Boston University
· Participant, MIT Technology and Policy Program
· M.S. Aerospace Engineering, Stanford University
· Graduate Student, United States Naval Academy
· MBA, University of Southern California

Publications (42)

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Conference on Empirical Methods in Natural Language Processing · 2023
1,151
cited
FNet: Mixing Tokens with Fourier Transforms
North American Chapter of the Association for Computational Linguistics · 2021
650
cited
Scaling Up Models and Data with t5x and seqio
Journal of machine learning research · 2022
212
cited
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
International Conference on Learning Representations · 2022
172
cited
Honeycomb Schrödinger Operators in the Strong Binding Regime
2016
92
cited
CoLT5: Faster Long-Range Transformers with Conditional Computation
Conference on Empirical Methods in Natural Language Processing · 2023
90
cited
Elliptic Operators with Honeycomb Symmetry: Dirac Points, Edge States and Applications to Photonic Graphene
Archive for Rational Mechanics and Analysis · 2017
82
cited
Edge States in Honeycomb Structures
2015
80
cited
Topologically protected states in one-dimensional continuous systems and Dirac points
Proceedings of the National Academy of Sciences of the United States of America · 2014
78
cited
Topologically Protected States in One-Dimensional Systems
2014
65
cited
Bifurcations of edge states—topologically protected and non-protected—in continuous 2D honeycomb structures
2015
29
cited
Modeling the relative dynamics of DNA-coated colloids.
Soft Matter · 2018
19
cited
Photonic realization of topologically protected bound states in domain-wall waveguide arrays
Conference on Lasers and Electro-Optics · 2016
18
cited
Effect of Step Anisotropy on Crystal Growth Inhibition by Immobile Impurity Stoppers
2017
14
cited
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT
Conference on Empirical Methods in Natural Language Processing · 2022
13
cited
Observation of highly robust phase-defect induced photonic states
Conference on Lasers and Electro-Optics · 2016
7
cited
Crystal Growth Inhibition by Mobile Randomly Distributed Stoppers
2020
6
cited
Bifurcation perspective on topologically protected and non-protected states in continuous systems
2016
3
cited
ShopTalk: A System for Conversational Faceted Search
arXiv.org · 2021
1
cited
Sotabase