Algorithmic information theory (original) (raw)
We introduce algorithmic information theory, also known as the theory of Kolmogorov complexity. We explain the main concepts of this quantitative approach to defining `information'. We discuss the extent to which Kolmogorov's and Shannon's information theory have a common purpose, and where they are fundamentally different. We indicate how recent developments within the theory allow one to formally distinguish between `structural' (meaningful) and `random' information as measured by the Kolmogorov structure function, which leads to a mathematical formalization of Occam's razor in inductive inference. We end by discussing some of the philosophical implications of the theory.
Related papers
Algorithmic Information Theory and Kolmogorov Complexity
2000
This document contains lecture notes of an introductory course on Kolmogorov complexity. They cover basic notions of algorithmic information theory: Kolmogorov complexity (plain, conditional, prefix), notion of randomness (Martin-Löf randomness, Mises–Church randomness), Solomonoff universal a priori probability and their properties (symmetry of information, connection between a priori probability and prefix complexity, criterion of randomness in terms of complexity) and applications (incompressibility method in computational complexity theory, incompleteness theorems).
Complexity and Information A Critical Evaluation of Algorithmic Information Theory
2014
Complexity is a catchword of certain extremely popular and rapidly devel oping interdisciplinary new sciences often called accordingly the sciences of complexity It is often closely associated with another notably popular but ambiguous word information information in turn may be justly called the central new concept in the whole th century science Moreover the notion of information is regularly coupled with a key concept of thermody namics viz entropy And like this was not enough it is quite usual to add one more at present extraordinarily popular notion namely chaos and wed it with the abovementioned concepts It is my aim in this paper to critically analyse this conceptual mess from a logical and philosophical point of view concentrating on the concepts of complexity and information and the question concerning the true relation between them I shall focus especially on the socalled algorithmic infor mation theory which has lately become extraordinarily popular especially in theoreti...
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.