5

Recently I asked a question about the relationship between Von Neumann entropy and heat transfer. The link is here.

Is the Von Neumann entropy related to heat transfer?

I feel as though the answer is not quite so clear so I will ask a couple of questions that I think may essentially be the same question as this previous one or, if these new questions aren't the same as the old question, your answers will help me clarify some key points.

Original question: Is the change in Von Neumann entropy related to heat transfer? I think I can rephrase and ask if information theory can explain heat transfer in terms of evolving information.

New Question #1:

The Wikipedia page "Maximum entropy thermodynamics" says under "Second Law": (paraphrased) Liouville's equation shows how the phase space evolves from a maximum entropy distribution to one that is not necessarily maximum entropy, yet the thermodynamic entropy is certainly maximized.

Does this mean what I think it does: that the evolution of information entropy and thermodynamic entropy are not the same? When I see people comparing information and thermodynamic entropy they always do it for a single state. But I don't think I've ever seen a discussion of whether, if the state evolves, the two entropies evolve to the same value. The Wiki article suggests to me that they don't. So, if they don't behave exactly the same, aren't they different things?

Here's the link: https://en.wikipedia.org/wiki/Maximum_entropy_thermodynamics

New Question #2:

Another Wiki article "Entropy in thermodynamics" says, under "Criticisms": (paraphrased) information has no concept of temperature or energy so thermodynamic and information entropies are not the same. Does anybody disagree with this?

Here's the link: https://en.wikipedia.org/wiki/Entropy_in_thermodynamics_and_information_theory#Criticism

SuchDoge
  • 427
  • If your out of equilibrium, defining temp is hard so thermo dynamic entropy isn’t well define. Also, I don’t think anyone disagrees. I have to think more to give a better answer – Shane P Kelly Feb 14 '18 at 01:14
  • This doesn't have to be about non-equilibrium. If the state evolves from one equilibrium to the next, is the information entropy of the new equilibrium state the same as the thermodynamic entropy of that new equilibrium state? – SuchDoge Feb 26 '18 at 18:29
  • @SuchDoge: Your main question seems to be: “Is von-Neumann entropy equivalent to the thermodynamic entropy in a physical sense?” Is my impression correct? – AlQuemist Mar 14 '18 at 09:04
  • "Liouville's equation shows how the phase space evolves from a maximum entropy distribution to one that is not necessarily maximum entropy, yet the thermodynamic entropy is certainly maximized. " I wasn't able to find this in the wiki article. The section on second law is discussing an issue with Liouville's theorem and how it requires you to take averages over time to account for the increase in entropy. I'll explain more in my answer – Shane P Kelly Mar 14 '18 at 14:05
  • Sorry, I didn't have time to explain in a full answer. Hopefully I get back to the question and not forget again. – Shane P Kelly Mar 14 '18 at 15:12
  • Read this http://bayes.wustl.edu/etj/articles/brandeis.pdf – WInterfell Mar 14 '18 at 18:08
  • Somewhat related: https://physics.stackexchange.com/q/137050/59023 – honeste_vivere Mar 16 '18 at 12:24
  • 1
    Closely related, if not a duplicate: https://physics.stackexchange.com/questions/263197/is-information-entropy-the-same-as-thermodynamic-entropy/263403#263403 – Rococo Mar 18 '18 at 18:32
  • Non-equilibrium thermodynamic entropy doesn't have a universally accepted meaning. But broadly speaking, the so-called "coarse-grained entropy" evolves like thermodynamic entropy, while von Neumann entropy does not. (Interestingly, both these were actually discovered by von Neumann.) In equilibrium they are the same. Details in these notes: https://arxiv.org/abs/2010.00142 – Joe Schindler Feb 18 '21 at 16:24

1 Answers1

2

Question 1

Liouville's equation shows how the phase space evolves from a maximum entropy distribution to one that is not necessarily maximum entropy [...]

I cannot find a reference to Liouville's equation in Wikipedia's entry on the second law. In fact, the above statement is wrong: Liouville's equation preserves entropy at all times, that is, the Liouville equation is capable of describing only an isentropic process.

Question 2

Another Wiki article "Entropy in thermodynamics" says, under "Criticisms": (paraphrased) information has no concept of temperature or energy so thermodynamic and information entropies are not the same. Does anybody disagree with this?

The criticism is unfounded on several levels:

  • Shannon only claimed to have identified the entropy functional. He was not interested in "energy" or "temperature". That doesn't mean that these concepts cannot exist within the formalism of information theory.
  • "Temperature" and "energy" are just names of variables that appear in certain physical problems. Jaynes realized this and drew the connection between Information Theory and Statistical Mechanics. Briefly, any positive variable $x$ whose mean is known is "energy"; "temperature" arises as a Lagrange multiplier when one seeks the probability distribution of $x$ that maximizes entropy given that its mean is known.
  • It is possible to recover the entire calculus of thermodynamics starting with the notion of the most probable distribution (https://arxiv.org/abs/1809.07367).
Themis
  • 5,843
  • thank you for your answer and sorry for the long wait for my reply. The Wiki page I refer to is the "Maximum entropy thermodynamics" page. I appreciate you providing input for some aspects of my questions. However, can you try to provide input more directly addressing the link (or lack-thereof) between Von Neuman entropy and heat transfer? – SuchDoge Feb 07 '20 at 21:35
  • Much of the confusion in entropy arises from semantics: What do you mean by "von Neuman entropy"? There are several "named" entropies with no clear distinctions between them: Shannon, Gibbs, Boltzmann, Neuman, "thermodynamic entropy", etc. – Themis Feb 14 '20 at 11:04
  • The von Neumann entropy that calculates the entropy of a quantum system. – SuchDoge Apr 06 '20 at 22:35