Sotabase

Career

· Embodied AI Engineer, Stealth CRX2026–
· Machine Learning Engineer, Chicago Education Advocacy Cooperative2025–2026
· MTA, Boston University2024–2024
· Research Intern, Boston University2024–2024
· Masters Robotics and autonomous systems, Boston University2023–2025
· Software Engineer, Cutso Foods LLP2021–2023

Publications (207)

Policy Gradient Methods for Reinforcement Learning with Function Approximation
Neural Information Processing Systems · 1999
7,417
cited
1,395
cited
1,185
cited
884
cited
Eligibility Traces for Off-Policy Policy Evaluation
International Conference on Machine Learning · 2000
876
cited
Neural Information Processing Systems · 2004
866
cited
Conference on Uncertainty in Artificial Intelligence · 2001
704
cited
Predictive Representations of State
Neural Information Processing Systems · 2001
589
cited
Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems
Neural Information Processing Systems · 1994
476
cited
471
cited
456
cited
IEEE Transactions on Autonomous Mental Development · 2010
445
cited
A Agent Environment StatesActions Rewards Critic B Agent Internal Environment Rewards Critic External Environment Sensations StatesDecisions Actions " Organism " Figure 1
2004
431
cited
Reinforcement Learning with Soft State Aggregation
Neural Information Processing Systems · 1994
403
cited
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Neural Information Processing Systems · 2014
371
cited
Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms
Neural Information Processing Systems · 1998
326
cited
Sotabase
Samarth Singh | Researcher Profile | Sotabase | Sotabase