Independence Conservation and Evolutionary Algorithms
Keywords:
independence conservation, conservation of information, algorithmic information theory, elegant program, mutual information, stochastic, deterministic, evolutionary algorithm, fitness, fitness function
Abstract
Leonid Levin developed the first stochastic conservation of information law, describing it as "torturing an uninformed witness cannot give information about the crime." Levin's law unifies both the deterministic and stochastic cases of conservation of information. A proof of Levin's law from Algorithmic Information Theory is given as well as a discussion of its implications in evolutionary algorithms and fitness functions.