Journal Article

·2006

Q-Learning with Probability Based Action Policy

Emrah Ugurlu YTU , Göksel Biricik YTU

Abstract

In Q-learning, the aim is to reach the goal by using state and action pairs. When the goal is set as a big reward, the optimal path is found as soon as the reward accumulated reaches its highest value. Upon modification of the start and goal points, the information concerning how to reach the goal becomes useless even if the environment does not change. In this study, Q-learning is improved by making the usage of the past data possible. To achieve this, action probabilities for certain start and goal points are found and a neural network is trained with those values to estimate the action probabilities for other start and goal points. A radial basis function network is used as neural network for it can support local representation and can learn fast when there is a few number of inputs. When Q-learning is run with the found action probabilities, an increase in speed is observed in reaching the goal.

Keywords

Action (physics) Computer science Set (abstract data type) Artificial neural network Path (computing) Representation (politics) Artificial intelligence Q-learning Function (biology) Machine learning Value (mathematics) Reinforcement learning

Subject Areas

Neural Networks and Applications ·Artificial Intelligence ·Physical Sciences
Neural Networks and Reservoir Computing ·Artificial Intelligence ·Physical Sciences
Reinforcement Learning in Robotics ·Artificial Intelligence ·Physical Sciences