ROOTS. “Information theory is deeply rooted in probability theory, to the extent that the axiomatic bases of both are formally equivalent. Both approaches, in turn, are illuminated by the seminal work of E.T. Jaynes on the foundations of thermodynamics, which proposes that probability theory can be understood as an extension of Aristotelian logic that applies to scenarios of partial or incomplete knowledge.”
https://lnkd.in/eFDvNHBt