Information/entropy relationship Issue #112961

What is the relationship between information and entropy? This issue is taken up elsewhere in the map. Claude Shannon introduced the concept of Information Entropy - so named because the relevant equations have exactly the same form. Follow the cross-link for more.
PAGE NAVIGATOR(Help)
Map HomeThe Arrow of Time
IssueThe experience of time
IssuePassage view components
IssueFlow and direction of time?
PositionMemory accretion hypothesis
ComponentDirection is that of memory accretion
IssueWhy aligned with thermodynamic arrow?
PositionInformation theoretic explanation
SupportiveArgumentArgument from computation
PremiseComputer memories need increasing entropy
SupportiveArgumentLandauer's Principle
IssueInformation/entropy relationship
RelevanceInformation and the Second Law
Citations
Landauer's Principle

Author: Hooker, Robert Perry - Computer Science grad student, University of Montana
Cited by: Peter Baldwin 6:01 AM Monday 4 July 2011 GMT
URL:
Excerpt / Summary
In 1961, Rolf Landauer published a landmark paper titled "Irreversibility and Heat Generation in the Computing Process" in which he observed that irreversible computational processes emit heat. Landauer's principle is significant because it provides a direct link between physics and information theory, and, as of this writing, the full importance of this connection is not fully understood.1

Thirteen years prior to Landauer's discovery, Claude Shannon launched the field of information theory with his seminal paper A Mathematical Theory of Communication. In this paper, Shannon defined the notion of information entropy, which quantifies the information content of any particular message.2 Interestingly, information entropy H was so named NOT because of a direct link to the thermodynamic quantity S, but because the formulas for S and H look exactly the same...
CommentsAdd a comment
Metadata

Entered by:- Peter Baldwin
Entry date (GMT): 7/4/2011 5:57:00 AM
Last edit date (GMT): 7/4/2011 6:00:00 AM
Incoming cross-relations: 1
Outgoing cross-relations: 1
Average rating: 0 by 0 users