Applying online search techniques to Continuous-State reinforcement learning (1998)
Scott Davies, Andrew Ng, Andrew Moore
Tags
Abstract
In this paper, we describe methods for efficiently computing better solutions to control problems in continuous state spaces. We provide algorithms that exploit online search to boost the power of very approximate value functions discovered by traditional reinforcement learning techniques. We examine local searches, where the agent performs a finite-depth lookahead search, and global searches, where the agent performs a search for a trajectory all the way from the current state to a goal state. The key to the success of the local methods lies in taking a value function, which gives a rough solution to the hard problem of finding good trajectories from every single state, and combining that with online search, which then gives an accurate solution to the easier problem of finding a good trajectory specifically from the current state. The key to the success of the global methods lies in using aggressive state-space search techniques such as uniform-cost search and A-star.
Full text
Download (application/pdf, 390.9 kB)
Approximate BibTeX Entry
@inproceedings{davies-applying,
Year = {1998},
Pages = {753-760},
Booktitle = {Proceedings of the Fifteenth National Conference on Artificial Intelligence},
Author = {
Scott Davies, Andrew Ng,
Andrew Moore
},
Title = {Applying online search techniques to Continuous-State reinforcement learning}
}