Sotabase

Career

· Associate Professor, Carnegie Mellon University2014–
· Research Assistant Professor, University of Southern California2009–2014
· Research Scientist, University of Southern California2007–2009
· Postdoctoral Researcher, Massachusetts Institute of Technology2006–2007
· MS in Computer Science, Massachusetts Institute of Technology2000–2002
· PhD in Computer Science, Massachusetts Institute of Technology2000–2006
· Research Assistant, Massachusetts Institute of Technology2000–2006
· Research Assistant, Laval University1998–1999
· B.S. in Computer Engineering, Laval University1995–2000

Publications (487)

Multimodal Machine Learning: A Survey and Taxonomy
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017
3,683
cited
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
Multimodal Transformer for Unaligned Multimodal Language Sequences
Annual Meeting of the Association for Computational Linguistics · 2019
1,829
cited
OpenFace 2.0: Facial Behavior Analysis Toolkit
IEEE International Conference on Automatic Face & Gesture Recognition · 2018
1,727
cited
OpenFace: An open source facial behavior analysis toolkit
IEEE Workshop/Winter Conference on Applications of Computer Vision · 2016
1,647
cited
Tensor Fusion Network for Multimodal Sentiment Analysis
Conference on Empirical Methods in Natural Language Processing · 2017
1,583
cited
Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Annual Meeting of the Association for Computational Linguistics · 2018
1,381
cited
Memory Fusion Network for Multi-view Sequential Learning
AAAI Conference on Artificial Intelligence · 2018
851
cited
Efficient Low-rank Multimodal Fusion With Modality-Specific Factors
Annual Meeting of the Association for Computational Linguistics · 2018
849
cited
Context-Dependent Sentiment Analysis in User-Generated Videos
Annual Meeting of the Association for Computational Linguistics · 2017
805
cited
It's only a computer: Virtual humans increase willingness to disclose
Computers in Human Behavior · 2014
773
cited
The Distress Analysis Interview Corpus of human and computer interviews
International Conference on Language Resources and Evaluation · 2014
709
cited
SimSensei kiosk: a virtual human interviewer for healthcare decision support
Adaptive Agents and Multi-Agent Systems · 2014
697
cited
Integrating Multimodal Information in Large Pretrained Transformers
Annual Meeting of the Association for Computational Linguistics · 2020
696
cited
Think Locally, Act Globally: Federated Learning with Local and Global Representations
arXiv.org · 2020
683
cited
Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages
IEEE Intelligent Systems · 2016
635
cited
MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos
arXiv.org · 2016
591
cited
Speaker-Follower Models for Vision-and-Language Navigation
Neural Information Processing Systems · 2018
567
cited
Hidden Conditional Random Fields
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2007
566
cited
Hidden Conditional Random Fields for Gesture Recognition
Computer Vision and Pattern Recognition · 2006
560
cited
Sotabase
Louis-Philippe Morency | Researcher Profile | Sotabase | Sotabase