Sotabase

Career

· Embodied AI Engineer, Stealth CRX2026–
· Machine Learning Engineer, Chicago Education Advocacy Cooperative2025–2026
· MTA, Boston University2024–2024
· Research Intern, Boston University2024–2024
· Masters Robotics and autonomous systems, Boston University2023–2025
· Software Engineer, Cutso Foods LLP2021–2023

Publications (207)

Policy Gradient Methods for Reinforcement Learning with Function Approximation
Neural Information Processing Systems · 1999
7,417
cited
Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning
Artificial Intelligence · 1999
4,030
cited
Learning to Act Using Real-Time Dynamic Programming
Artificial Intelligence · 1995
1,395
cited
Near-Optimal Reinforcement Learning in Polynomial Time
Machine-mediated learning · 2002
1,185
cited
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Neural Computation · 1994
1,110
cited
Action-Conditional Video Prediction using Deep Networks in Atari Games
Neural Information Processing Systems · 2015
884
cited
Eligibility Traces for Off-Policy Policy Evaluation
International Conference on Machine Learning · 2000
876
cited
Intrinsically Motivated Reinforcement Learning
Neural Information Processing Systems · 2004
866
cited
Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms
Machine-mediated learning · 2000
742
cited
Graphical Models for Game Theory
Conference on Uncertainty in Artificial Intelligence · 2001
704
cited
Predictive Representations of State
Neural Information Processing Systems · 2001
589
cited
Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems
Neural Information Processing Systems · 1994
476
cited
Learning Without State-Estimation in Partially Observable Markovian Decision Processes
International Conference on Machine Learning · 1994
471
cited
Reinforcement Learning with Replacing Eligibility Traces
Machine-mediated learning · 2005
456
cited
Intrinsically Motivated Reinforcement Learning: An Evolutionary Perspective
IEEE Transactions on Autonomous Mental Development · 2010
445
cited
A Agent Environment StatesActions Rewards Critic B Agent Internal Environment Rewards Critic External Environment Sensations StatesDecisions Actions " Organism " Figure 1
2004
431
cited
Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System
Journal of Artificial Intelligence Research · 2011
428
cited
Reinforcement Learning with Soft State Aggregation
Neural Information Processing Systems · 1994
403
cited
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Neural Information Processing Systems · 2014
371
cited
Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms
Neural Information Processing Systems · 1998
326
cited
Sotabase
Samarth Singh | Researcher Profile | Sotabase | Sotabase