Sotabase

Career

· Principal Software Engineer, Rocket Mortgage2025–
· Staff Full Stack Software Engineer, Panther2022–2025
· Senior Staff Software Engineer, PayPal2015–2022
· Founding Engineer, Modest, Inc2013–2015

Publications (21)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Neural Information Processing Systems · 2022
1,197
cited
TIES-Merging: Resolving Interference When Merging Models
Neural Information Processing Systems · 2023
556
cited
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP
Transactions of the Association for Computational Linguistics · 2021
214
cited
Improving and Simplifying Pattern Exploiting Training
Conference on Empirical Methods in Natural Language Processing · 2021
155
cited
Evaluating the Factual Consistency of Large Language Models Through News Summarization
Annual Meeting of the Association for Computational Linguistics · 2022
132
cited
Evaluating the Factual Consistency of Large Language Models Through Summarization
arXiv.org · 2022
34
cited
Merging by Matching Models in Task Parameter Subspaces
Trans. Mach. Learn. Res. · 2023
21
cited
Optimal Transport-based Alignment of Learned Character Representations for String Similarity
Annual Meeting of the Association for Computational Linguistics · 2019
16
cited
Isochrony-Aware Neural Machine Translation for Automatic Dubbing
Interspeech · 2021
11
cited
Realistic Evaluation of Model Merging for Compositional Generalization
arXiv.org · 2024
11
cited
Simple Weakly-Supervised Image Captioning via CLIP’s Multimodal Embeddings
2023
3
cited
Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator
International Conference on Machine Learning · 2025
2
cited
Prosody-Aware Neural Machine Translation for Dubbing
arXiv.org · 2021
2
cited
P ERFECT : Prompt-free and Efficient Language Model Fine-Tuning
2021
1
cited
On the Analysis and Distillation of Emergent Outlier Properties in Pre-trained Language Models
North American Chapter of the Association for Computational Linguistics · 2025
Predicting Institution Hierarchies with Set-based Models
Conference on Automated Knowledge Base Construction · 2020
Project Report: Gendered Pronoun Coreference Resolution
2019
SCULPT: Systematic Tuning of Long Prompts
What are Adapters Really Efficient At?
2023
Sotabase
Derek Tam | Researcher Profile | Sotabase | Sotabase