Sotabase

Career

· Postdoctoral Researcher, University of Oxford

Publications (7)

HyperMixer: An MLP-based Low Cost Alternative to Transformers
Annual Meeting of the Association for Computational Linguistics · 2022
14
cited
A VAE for Transformers with Nonparametric Variational Information Bottleneck
International Conference on Learning Representations · 2023
13
cited
HyperMixer: An MLP-based Green AI Alternative to Transformers
arXiv.org · 2022
8
cited
A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck
arXiv.org · 2022
5
cited
Learning to Abstract with Nonparametric Variational Information Bottleneck
Conference on Empirical Methods in Natural Language Processing · 2023
4
cited
Nonparametric Variational Regularisation of Pretrained Transformers
arXiv.org · 2023
3
cited
F INE -T UNING P RETRAINED M ODELS WITH NVIB FOR I MPROVED G ENERALISATION
Sotabase