Entropy - A Guide for the Perplexed

Citation data:

Probabilities in Physics

Publication Year:
Usage 2181
Downloads 2181
Social Media 2
Tweets 2
Repository URL:
Frigg, Roman; Werndl, Charlotte
Oxford University Press
Most Recent Tweet View All Tweets
preprint description
Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the most important notions of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy (Section 2), we discuss notions of entropy in information theory (Section 3), statistical mechanics (Section 4), dynamical systems theory (Section 5) and fractal geometry (Section 6).