January 27, 2015
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a measure of uncertainty. In this Letter, we connect these two notions of entropy, using an axiomatic framework for thermodynamics [Lieb, Yngvason, Proc. Roy. Soc.(2013)]. In particular, we obtain a direct relation between the Clausius entropy and the Shannon entropy, or its generalisation to quantum systems, the von Neumann entropy. More generally, we find that entropy measures relevant in non-equilibrium thermodynamics correspond to entropies used in one-shot information theory.
Similar papers 1
June 25, 2012
A new axiomatic characterization with a minimum of conditions for entropy as a function on the set of states in quantum mechanics is presented. Traditionally unspoken assumptions are unveiled and replaced by proven consequences of the axioms. First the Boltzmann-Planck formula is derived. Building on this formula, using the Law of Large Numbers - a basic theorem of probability theory - the von Neumann formula is deduced. Axioms used in older theories on the foundations are no...
May 20, 2007
We have presented first an axiomatic derivation of Boltzmann entropy on the basis of two axioms consistent with two basic properties of thermodynamic entropy. We have then studied the relationship between Boltzmann entropy and information along with its physical significance.
January 11, 2018
We present an axiomatic framework for thermodynamics that incorporates information as a fundamental concept. The axioms describe both ordinary thermodynamic processes and those in which information is acquired, used and erased, as in the operation of Maxwell's demon. This system, like previous axiomatic systems for thermodynamics, supports the construction of conserved quantities and an entropy function governing state changes. Here, however, the entropy exhibits both informa...
April 9, 2022
Even today, the concept of entropy is perceived by many as quite obscure. The main difficulty is analyzed as being fundamentally due to the subjectivity and anthropocentrism of the concept that prevent us to have a sufficient distance to embrace it. However, it is pointed out that the lack of coherence of certain presentations or certain preconceived ideas do not help. They are of three kinds : 1) axiomatic thermodynamics; 2) inconsistent solutions of certain paradoxes; 3) re...
October 26, 2017
Entropy concept was introduced by Clausius 160 years ago, and has been continually enriched, developed and interpreted by the researchers in many different scientific disciplines ever since. Thermodynamics and other scientific disciplines face several simple but crucial questions concerning the entropy concept. Thus, it is frequently possible to notice a misuse of entropy. Sometimes unbelievable confusion in the literature is summarized by von Neumann's sentence: "No one know...
March 23, 2014
The principal methods for the definition of thermodynamic entropy are discussed with special reference to those developed by Carath\'eodory, the Keenan School, Lieb and Yngvason, and the present authors. An improvement of the latter method is then presented. Seven basic axioms are employed: three Postulates, which are considered as having a quite general validity, and four Assumptions, which identify the domains of validity of the definitions of energy (Assumption 1) and entr...
July 19, 2018
Thermodynamics can be formulated in either of two approaches, the phenomenological approach, which refers to the macroscopic properties of systems, and the statistical approach, which describes systems in terms of their microscopic constituents. We establish a connection between these two approaches by means of a new axiomatic framework that can take errors and imprecisions into account. This link extends to systems of arbitrary sizes including microscopic systems, for which ...
November 18, 2019
From a new rigorous formulation of the general axiomatic foundations of thermodynamics we derive an operational definition of entropy that responds to the emergent need in many technological frameworks to understand and deploy thermodynamic entropy well beyond the traditional realm of equilibrium states of macroscopic systems. The new treatment starts from a previously developed set of carefully worded operational definitions for all the necessary basic concepts, and is not b...
September 27, 2013
Thermodynamic entropy is determined by a heat measurement through the Clausius equality. The entropy then formalizes a fundamental limitation of operations by the second law of thermodynamics. The entropy is also expressed as the Shannon entropy of the microscopic degrees of freedom. Whenever an extension of thermodynamic entropy is attempted, we must pay special attention to how its three different aspects just mentioned are altered. In this paper, we discuss possible extens...
March 24, 2000
This paper is a non-technical, informal presentation of our theory of the second law of thermodynamics as a law that is independent of statistical mechanics and that is derivable solely from certain simple assumptions about adiabatic processes for macroscopic systems. It is not necessary to assume a-priori concepts such as "heat", "hot and cold", "temperature". These are derivable from entropy, whose existence we derive from the basic assumptions. See cond-mat/9708200 and mat...