Shimon Whiteson's Publications

Sorted by DateClassified by Publication Type

Multi-Task Evolutionary Shaping Without Pre-Specified Representations

Matthijs Snel and Shimon Whiteson. Multi-Task Evolutionary Shaping Without Pre-Specified Representations. In GECCO 2010: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 1031–1038, July 2010.

Download

[PDF]211.5kB  

Abstract

Shaping functions can be used in multi-task reinforcement learning (RL) to incorporate knowledge from previously experienced tasks to speed up learning on a new task. So far, researchers have pre-specified a separate representation for shaping and value functions in multi-task settings. However, no work has made precise what distinguishes these representations, or what makes a good representation for either function. This paper shows two alternative methods by which an evolutionary algorithm can find a shaping function in multi-task RL without pre-specifying a separate representation. The second method, which uses an indirect fitness measure, is demonstrated to achieve similar performance to the first against a significantly lower computational cost. In addition, we define a formal categorisation of representations that makes precise what makes a good representation for shaping and value functions. We validate the categorisation with an evolutionary feature selection method and show that this method chooses the representations that our definitions predict are suitable.

BibTeX Entry

@InProceedings{snel:gecco10,
  author       = "Matthijs Snel and Shimon Whiteson",
  title	       = "Multi-Task Evolutionary Shaping Without Pre-Specified Representations",
  booktitle    = "GECCO 2010: Proceedings of the Genetic and Evolutionary Computation Conference",
  month	       = "July",
  pages	       = "1031-1038",  
  year	       = 2010,
}

Generated by bib2html.pl (written by Patrick Riley ) on Sun Apr 13, 2014 08:30:02