SHANNON VS BOLTZMANN. “Even when reduced to common units, however, typical values of the two entropies differ vastly in magnitude. A silicon microchip carrying a gigabyte of data, for instance, has a Shannon entropy of about 10(10) bits (one byte is eight bits), tremendously smaller than the chip’s thermodynamic entropy, which is about 10(23) bits at room temperature.”
https://lnkd.in/draqjTW