Information diagram (original) (raw)
An information diagram is a type of Venn diagram used in information theory to illustrate relationships among Shannon's basic measures of information: entropy, joint entropy, conditional entropy and mutual information. Information diagrams are a useful pedagogical tool for teaching and learning about these basic measures of information. Information diagrams have also been applied to specific problems such as for displaying the information theoretic similarity between sets of ontological terms. * *
| Property | Value |
|---|---|
| dbo:abstract | An information diagram is a type of Venn diagram used in information theory to illustrate relationships among Shannon's basic measures of information: entropy, joint entropy, conditional entropy and mutual information. Information diagrams are a useful pedagogical tool for teaching and learning about these basic measures of information. Information diagrams have also been applied to specific problems such as for displaying the information theoretic similarity between sets of ontological terms. * Venn diagram showing additive and subtractive relationships among various information measures associated with correlated variables X and Y. The area contained by both circles is the joint entropy . The circle on the left (red and violet) is the individual entropy , with the red being the conditional entropy . The circle on the right (blue and violet) is , with the blue being . The violet is the mutual information . * Venn diagram of information theoretic measures for three variables x, y, and z. Each circle represents an individual entropy: is the lower left circle, the lower right, and is the upper circle. The intersections of any two circles represents the mutual information for the two associated variables (e.g. is yellow and gray). The union of any two circles is the joint entropy for the two associated variables (e.g. is everything but green). The joint entropy of all three variables is the union of all three circles. It is partitioned into 7 pieces, red, blue, and green being the conditional entropies respectively, yellow, magenta and cyan being the conditional mutual informations and respectively, and gray being the interaction information . The interaction information is the only one of all that may be negative. (en) |
| dbo:thumbnail | wiki-commons:Special:FilePath/Entropy-mutual-inform...ntropy-relation-diagram.svg?width=300 |
| dbo:wikiPageID | 18372173 (xsd:integer) |
| dbo:wikiPageLength | 3339 (xsd:nonNegativeInteger) |
| dbo:wikiPageRevisionID | 1062726719 (xsd:integer) |
| dbo:wikiPageWikiLink | dbr:Correlated_variables dbr:Joint_entropy dbr:Information_distance dbr:Interaction_information dbc:Diagrams dbr:Conditional_entropy dbr:Entropy_(information_theory) dbr:Mutual_information dbr:Conditional_mutual_information dbc:Set_theory dbc:Information_theory dbr:Information_theory dbr:Ontology_(information_science) dbr:Venn_diagram dbr:Quantities_of_information dbr:Information_entropy |
| dbp:wikiPageUsesTemplate | dbt:Mvar dbt:Reflist dbt:Tmath dbt:Settheory-stub |
| dct:subject | dbc:Diagrams dbc:Set_theory dbc:Information_theory |
| gold:hypernym | dbr:Diagram |
| rdf:type | dbo:Software yago:Artifact100021939 yago:Creation103129123 yago:Diagram103186399 yago:Drawing103234306 yago:Object100002684 yago:PhysicalEntity100001930 yago:Representation104076846 yago:Whole100003553 yago:WikicatDiagrams |
| rdfs:comment | An information diagram is a type of Venn diagram used in information theory to illustrate relationships among Shannon's basic measures of information: entropy, joint entropy, conditional entropy and mutual information. Information diagrams are a useful pedagogical tool for teaching and learning about these basic measures of information. Information diagrams have also been applied to specific problems such as for displaying the information theoretic similarity between sets of ontological terms. * * (en) |
| rdfs:label | Information diagram (en) |
| owl:sameAs | freebase:Information diagram wikidata:Information diagram https://global.dbpedia.org/id/fQb5 yago-res:Information diagram |
| prov:wasDerivedFrom | wikipedia-en:Information_diagram?oldid=1062726719&ns=0 |
| foaf:depiction | wiki-commons:Special:FilePath/Entropy-mutual-inform...relative-entropy-relation-diagram.svg wiki-commons:Special:FilePath/VennInfo3Var.svg |
| foaf:isPrimaryTopicOf | wikipedia-en:Information_diagram |
| is dbo:wikiPageRedirects of | dbr:Entropy_diagram |
| is dbo:wikiPageWikiLink of | dbr:Information_theory_and_measure_theory dbr:Entropy_diagram dbr:Venn_diagram |
| is foaf:primaryTopic of | wikipedia-en:Information_diagram |
