Overview

Anticipatory Learning Classifier Systems describes the state of the art of anticipatory learning classifier systems-adaptive rule learning systems that autonomously build anticipatory environmental models. An anticipatory model specifies all possible action-effects in an environment with respect to given situations. It can be used to simulate anticipatory adaptive behavior. Anticipatory Learning Classifier Systems highlights how anticipations influence cognitive systems and illustrates the use of anticipations for (1) faster reactivity, (2) adaptive behavior beyond reinforcement learning, (3) attentional mechanisms, (4) simulation of other agents and (5) the implementation of a motivational module. The book focuses on a particular evolutionary model learning mechanism, a combination of a directed specializing mechanism and a genetic generalizing mechanism. Experiments show that anticipatory adaptive behavior can be simulated by exploiting the evolving anticipatory model for even faster model learning, planning applications, and adaptive behavior beyond reinforcement learning. Anticipatory Learning Classifier Systems gives a detailed algorithmic description as well as a program documentation of a C++ implementation of the system.

Full Product Details

Author:   Martin V. Butz
Publisher:   Springer-Verlag New York Inc.
Imprint:   Springer-Verlag New York Inc.
Edition:   Softcover reprint of the original 1st ed. 2002
Volume:   4
Dimensions:   Width: 15.50cm , Height: 1.00cm , Length: 23.50cm
Weight:   0.320kg
ISBN:  

9781461352907

ISBN 10:   1461352908
Pages:   172
Publication Date:   05 November 2012
Audience:   Professional and scholarly ,  Professional & Vocational
Format:   Paperback
Publisher's Status:   Active
Availability:   Manufactured on demand  
We will order this item for you from a manufactured on demand supplier.

Table of Contents

1. Background.- 1. Anticipations.- 2. Genetic Algorithms.- 3. Learning Classifier Systems.- 2. ACS2.- 1. Framework.- 2. Reinforcement Learning.- 3. The Anticipatory Learning Process.- 4. Genetic Generalization in ACS2.- 5. Interaction of ALP, GA, RL, and Behavior.- 3. Experiments with ACS2.- 1. Gripper Problem Revisited.- 2. Multiplexer Problem.- 3. Maze Environment.- 4. Blocks World.- 5. Hand-Eye Coordination Task.- 6. Result Summary.- 4. Limits.- 1.GA Challenges.- 2.Non-determinism and a First Approach.- 3. Model Aliasing.- 5. Model Exploitation.- 1. Improving Model Learning.- 2. Enhancing Reinforcement Learning.- 3. Model Exploitation Recapitulation.- 6. Related Systems.- 1. Estimated Learning Algorithm.- 2. Dyna.- 3. Schema Mechanism.- 4. Expectancy Model SRS/E.- 7. Summary, Conclusions, and Future Work.- 1. Summary.- 2. Model Representation Enhancements.- 3. Model Learning Modifications.- 4. Adaptive Behavior.- 5. ACS2 in the Future.- Appendices.- References.

Reviews

Author Information

Tab Content 6

Author Website:  

Customer Reviews

Recent Reviews

No review item found!

Add your own review!

Countries Available

All regions