Sotabase

Career

· Research Scientist, Google

Publications (24)

Quantifying Attention Flow in Transformers
Annual Meeting of the Association for Computational Linguistics · 2020
1,039
cited
Long Range Arena: A Benchmark for Efficient Transformers
International Conference on Learning Representations · 2020
842
cited
GAUDI: A Neural Architect for Immersive 3D Scene Generation
Neural Information Processing Systems · 2022
157
cited
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
arXiv.org · 2021
140
cited
Exploring the Limits of Large Scale Pre-training
International Conference on Learning Representations · 2021
134
cited
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Conference on Empirical Methods in Natural Language Processing · 2022
121
cited
Blackbox Meets Blackbox: Representational Similarity & Stability Analysis of Neural Language Models and Brains
BlackboxNLP@ACL · 2019
81
cited
Transferring Inductive Biases through Knowledge Distillation
arXiv.org · 2020
68
cited
Scale Efficiently: Insights from Pretraining and Finetuning Transformers
International Conference on Learning Representations · 2022
65
cited
Experiential, Distributional and Dependency-based Word Embeddings have Complementary Roles in Decoding Brain Activity
Workshop on Cognitive Modeling and Computational Linguistics · 2017
55
cited
An evolutionary algorithm for forming mixed groups of learners in web based collaborative learning environments
2012 IEEE International Conference on Technology Enhanced Education (ICTEE) · 2012
40
cited
Gradual Domain Adaptation in the Wild: When Intermediate Distributions are Absent
arXiv.org · 2021
28
cited
Expanded N-Grams for Semantic Text Alignment Notebook for PAN at CLEF 2014
Conference and Labs of the Evaluation Forum · 2014
19
cited
Robust Evaluation of Language-Brain Encoding Experiments
Conference on Intelligent Text Processing and Computational Linguistics · 2019
17
cited
A Comparison of Architectures and Pretraining Methods for Contextualized Multilingual Word Embeddings
AAAI Conference on Artificial Intelligence · 2019
16
cited
Authorship Identification Using Dynamic Selection of Features from Probabilistic Feature Set
Conference and Labs of the Evaluation Forum · 2014
13
cited
Adaptivity and Modularity for Efficient Generalization Over Task Complexity
arXiv.org · 2023
8
cited
The Healing Power of Poison: Helpful Non-relevant Documents in Feedback
International Conference on Information and Knowledge Management · 2016
6
cited
Meta Text Aligner: Text Alignment Based on Predicted Plagiarism Relation
Conference and Labs of the Evaluation Forum · 2015
5
cited
Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP
Neural Information Processing Systems · 2024
4
cited
Sotabase
Samira Abnar | Researcher Profile | Sotabase | Sotabase