Sotabase

Career

· Co-CEO, Yutori2024–
· Senior Director in Generative AI, Meta2021–2024
· Associate Professor, School of Interactive Computing, Georgia Institute of Technology2016–2024
· Research Scientist, Meta (Facebook AI Research - FAIR)2016–2021
· Assistant Professor, Bradley Department of Electrical and Computer Engineering, Virginia Tech2013–2016
· Research Assistant Professor, Toyota Technological Institute at Chicago (TTIC)2009–2012
· Ph.D. in Electrical and Computer Engineering, Carnegie Mellon University2005–2009
· B.S. in Electrical and Computer Engineering, Rowan University2001–2005

Publications (298)

Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
International Journal of Computer Vision · 2016
24,662
cited
The Llama 3 Herd of Models
2024
12,282
cited
VQA: Visual Question Answering
International Journal of Computer Vision · 2015
6,144
cited
CIDEr: Consensus-based image description evaluation
Computer Vision and Pattern Recognition · 2014
5,190
cited
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Neural Information Processing Systems · 2019
4,253
cited
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
International Journal of Computer Vision · 2016
3,875
cited
Make-A-Video: Text-to-Video Generation without Text-Video Data
International Conference on Learning Representations · 2022
1,822
cited
Towards VQA Models That Can Read
Computer Vision and Pattern Recognition · 2019
1,756
cited
Hierarchical Question-Image Co-Attention for Visual Question Answering
Neural Information Processing Systems · 2016
1,703
cited
Habitat: A Platform for Embodied AI Research
IEEE International Conference on Computer Vision · 2019
1,699
cited
Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization
2016
1,632
cited
Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning
Computer Vision and Pattern Recognition · 2016
1,586
cited
Visual Dialog
Computer Vision and Pattern Recognition · 2016
1,068
cited
Relative attributes
Vision · 2011
1,004
cited
Graph R-CNN for Scene Graph Generation
European Conference on Computer Vision · 2018
906
cited
Joint Unsupervised Learning of Deep Representations and Image Clusters
Computer Vision and Pattern Recognition · 2016
865
cited
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
North American Chapter of the Association for Computational Linguistics · 2016
776
cited
Embodied Question Answering
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2017
719
cited
The Open Catalyst 2020 (OC20) Dataset and Community Challenges
ACS Catalysis · 2020
680
cited
Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · 2017
649
cited
Sotabase