Package org.leialearns

The LEIA system is a learning system that learns from interacting with a completely unknown environment over a bidirectional steam of symbols.

See: Description

Interface Summary

Interface	Description
LEIA	LEIA.

Package org.leialearns Description

The LEIA system is a learning system that learns from interacting with a completely unknown environment over a bidirectional steam of symbols.

The system consists of a few parts that update various models in parallel.

• An Encounter communicates directly with the environment and updates counters.
• An Observer consolidates counters into a model of observed behavior. The model of observed behavior includes a structure of extra accounting information named deltas that reduce the computation effort of other steps.
• A Minimizer applies the Minimum Description Length Principle (MDL) to the model of observed behavior, to produce updates for the model of expected behavior.
• A Consolidator combines incremental improvements found by the minimizer into a consolidated model of expected behavior.
• A maximizer searches for ways to improve the strategy.
• The Encounter uses the last strategy to interact with the environment.

The simple, but profound, basis for LEIA is the balance between the designed function of the minimizer and the designed function of the maximizer. The minimizer keeps the total description length of the model of expected behavior as short as possible while still encoding all statistically relevant information about the model of observed behavior. The maximizer, at the other hand, searches for strategies that make the total description length of the model of expected behavior longer. The maximizer can only increase the length of the model of expected behavior by selecting strategies that maximize the expected model growth given the differences between the model of observed behavior and the model of expected behavior