CitationsAdd new citationList by: CiterankMap Link[1] Landauer's Principle
Author: Hooker, Robert Perry - Computer Science grad student, University of Montana Cited by: Peter Baldwin 6:39 AM 7 September 2015 GMT Citerank: (1) 112961Information/entropy relationshipWhat is the relationship between information and entropy? This issue is taken up elsewhere in the map. Claude Shannon introduced the concept of Information Entropy - so named because the relevant equations have exactly the same form. Follow the cross-link for more.8FFB597 URL:
| Excerpt / Summary In 1961, Rolf Landauer published a landmark paper titled "Irreversibility and Heat Generation in the Computing Process" in which he observed that irreversible computational processes emit heat. Landauer's principle is significant because it provides a direct link between physics and information theory, and, as of this writing, the full importance of this connection is not fully understood.1
Thirteen years prior to Landauer's discovery, Claude Shannon launched the field of information theory with his seminal paper A Mathematical Theory of Communication. In this paper, Shannon defined the notion of information entropy, which quantifies the information content of any particular message.2 Interestingly, information entropy H was so named NOT because of a direct link to the thermodynamic quantity S, but because the formulas for S and H look exactly the same... |
|