Sotabase

Career

· Research Scientist, OpenAI2023–
· Postdoctoral Researcher, UC Berkeley Artificial Intelligence Research lab2021–2023
· Research Intern, Facebook AI Research2017–
· Research Intern, Google Brain2016–
· Doctor of Philosophy - PhD in Computer Science, New York University2016–2021
· PhD Student, New York University2016–2021
· Research Intern (Mobile Vision group), Google2015–
· Master of Science (MSc) in Media Informatics, RWTH Aachen University2011–2014
· Specialist Degree in Applied Mathematics and Computer Science, Immanuel Kant Baltic Federal University2006–2011

Publications (57)

GPT-4o System Card
arXiv.org · 2024
2,980
cited
Offline Reinforcement Learning with Implicit Q-Learning
International Conference on Learning Representations · 2021
1,237
cited
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
International Conference on Learning Representations · 2020
882
cited
Training Diffusion Models with Reinforcement Learning
International Conference on Learning Representations · 2023
673
cited
Improving Sample Efficiency in Model-Free Reinforcement Learning from Images
AAAI Conference on Artificial Intelligence · 2019
497
cited
PlaNet - Photo Geolocation with Convolutional Neural Networks
European Conference on Computer Vision · 2016
461
cited
Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
International Conference on Learning Representations · 2017
362
cited
Offline Reinforcement Learning with Fisher Divergence Critic Regularization
International Conference on Machine Learning · 2021
341
cited
Discriminator-Actor-Critic: Addressing Sample Inefficiency and Reward Bias in Adversarial Imitation Learning
2018
282
cited
Efficient Online Reinforcement Learning with Offline Data
International Conference on Machine Learning · 2023
272
cited
AlgaeDICE: Policy Gradient from Arbitrary Experience
arXiv.org · 2019
258
cited
IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policies
arXiv.org · 2023
233
cited
Imitation Learning via Off-Policy Distribution Matching
International Conference on Learning Representations · 2019
229
cited
RvS: What is Essential for Offline RL via Supervised Learning?
International Conference on Learning Representations · 2021
215
cited
Offline RL for Natural Language Generation with Implicit Language Q Learning
International Conference on Learning Representations · 2022
137
cited
An Efficient Convolutional Network for Human Pose Estimation
British Machine Vision Conference · 2016
135
cited
Automatic Data Augmentation for Generalization in Reinforcement Learning
Neural Information Processing Systems · 2021
128
cited
A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning
arXiv.org · 2022
127
cited
Automatic Data Augmentation for Generalization in Deep Reinforcement Learning
arXiv.org · 2020
115
cited
Surface Networks
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · 2017
106
cited
Sotabase