Sotabase

Career

· ML Research Scientist Intern, Apple2024–
· Research Scientist, Google DeepMind2024–
· Research Intern, Meta AI2023–2023
· Research Intern, DeepMind2022–2022
· Research Intern, Amazon Science2021–2021
· PhD in Computer Science, McGill University2020–2025
· MS in Computer Science, McGill University2018–2020
· BEng in Electrical Engineering, Polytechnique Montreal2014–2018

Publications (22)

When Waiting is not an Option : Learning Options with a Deliberation Cost
AAAI Conference on Artificial Intelligence · 2017
164
cited
Motif: Intrinsic Motivation from Artificial Intelligence Feedback
International Conference on Learning Representations · 2023
90
cited
Learnings Options End-to-End for Continuous Action Tasks
arXiv.org · 2017
60
cited
Options of Interest: Temporal Abstraction with Interest Functions
AAAI Conference on Artificial Intelligence · 2020
50
cited
Flexible Option Learning
Neural Information Processing Systems · 2021
31
cited
Deep Laplacian-based Options for Temporally-Extended Exploration
International Conference on Machine Learning · 2023
29
cited
Code as Reward: Empowering Reinforcement Learning with VLMs
International Conference on Machine Learning · 2024
24
cited
Reward Propagation Using Graph Convolutional Networks
Neural Information Processing Systems · 2020
22
cited
MaestroMotif: Skill Design from Artificial Intelligence Feedback
International Conference on Learning Representations · 2024
12
cited
On the Modeling Capabilities of Large Language Models for Sequential Decision Making
International Conference on Learning Representations · 2024
7
cited
Discovering Temporal Structure: An Overview of Hierarchical Reinforcement Learning
arXiv.org · 2025
6
cited
Adaptive Interest for Emphatic Reinforcement Learning
Neural Information Processing Systems · 2022
3
cited
Diffusion-Based Approximate Value Functions
2018
3
cited
Real-time Narrow-Band Frequency-Shift Keying ( FSK ) Receiver
2017
Sotabase
Martin Klissarov | Researcher Profile | Sotabase | Sotabase