AIC Seminar Series
Reinforcement Learning Approach to Stochastic Planning Problems
|Kee-Eung Kim||Interaction Lab, Samsung Advanced Institute of Technology|
Date: Monday, January 30th 2006 at 10:00am
Location: EJ228 (Directions)
This talk is concerned with adapting reinforcement learning algorithms for efficiently solving large and complex stochastic planning problems. A planning problem is specified in terms of a model of the environment in which an agent must execute actions to achieve a specified goal or attain a given level of performance. Executing an action results in a transition from one state of the environment to another state and, generally, the agent has to perform a sequence of actions and visit a set of states in order to provide a satisfactory solution to the planning problem. Stochastic planning problems are the case in which the state transitions are specified as probability distributions. Examples of planning problems include path planning in robotics, resource management in logistics, and controlling interface agents in HCI.
The class of stochastic planning problems is known to be computationally difficult and consequently the techniques that take advantage of regularities in particular planning domains are necessary. Reinforcement learning algorithms have been applied to various models of planning problems, and their limitations and issues have been discovered. Specifically, when the agent is confronted with noisiness or enormous amount of observations, traditional approach of naively applying reinforcement learning techniques is likely to fail. This phenomenon is critical in the sense that noisy and abundant observations are inherent in real-world environments e.g., robots with a lot of sensors that sometimes fail to return accurate values. I will present a new framework for adapting reinforcement learning algorithms to overcome these issues, and show the details of adaptation for specific planning problem models. I will also demonstrate the effectiveness of these algorithms on a number of interesting planning problems by showing experimental results.
Please arrive at least 10 minutes early as you will need to sign in by
following instructions by the lobby phone at Building E. (or call Wilma
Lenz at 650 859 4904, or Vicenta at Lopez at 650 859 5750). SRI is
located at 333 Ravenswood Avenue in Menlo Park. Visitors may park in the
parking lots off Fourth Street. Detailed directions to SRI, as well as maps,
are available from the Visiting AIC web page.
There are two entrances to SRI International located on Ravenswood Ave.
Please check the Builing E entrance signage.
©2017 SRI International 333 Ravenswood Avenue, Menlo Park, CA 94025-3493