Question 15.9: Suppose you toss 100 coins starting with 60 heads and 40 tai...

Suppose you toss 100 coins starting with 60 heads and 40 tails, and you get the most likely result, 50 heads and 50 tails. What is the change in entropy?

Strategy
Noting that the number of microstates is labeled W in Table 15.4

Macrostate Number of microstates
Heads Tails (W)
100 0 1
99 1 1.0 \times 10^{2}
95 5 7.5 \times 10^{7}
90 10 1.7 \times 10^{13}
75 25 2.4 \times 10^{23}
60 40 1.4 \times 10^{28}
55 45 6.1 \times 10^{28}
51 49 9.9 \times 10^{28}
50 50 1.0 \times 10^{29}
49 51 9.9 \times 10^{28}
45 55 6.1 \times 10^{28}
40 60 1.4 \times 10^{28}
25 75 2.4 \times 10^{23}
10 90 1.7 \times 10^{13}
5 95 7.5 \times 10^{7}
1 99 1.0 \times 10^{2}
0 100 1
Total: 1.27 \times 10^{30}

for the 100-coin toss, we can use \Delta S=S_{ f }-S_{ i }=k \ln W_{ f }-k \ln W_{ i } to calculate the change in entropy.

The Blue Check Mark means that this solution has been answered and checked by an expert. This guarantees that the final answer is accurate.
Learn more on how we answer questions.

The change in entropy is

\Delta S=S_{ f }-S_{ i }=k \ln W_{ f }-k \ln W_{ i },                         (15.69)

where the subscript i stands for the initial 60 heads and 40 tails state, and the subscript f for the final 50 heads and 50 tails state. Substituting the values for W from Table 15.4

Macrostate Number of microstates
Heads Tails (W)
100 0 1
99 1 1.0 \times 10^{2}
95 5 7.5 \times 10^{7}
90 10 1.7 \times 10^{13}
75 25 2.4 \times 10^{23}
60 40 1.4 \times 10^{28}
55 45 6.1 \times 10^{28}
51 49 9.9 \times 10^{28}
50 50 1.0 \times 10^{29}
49 51 9.9 \times 10^{28}
45 55 6.1 \times 10^{28}
40 60 1.4 \times 10^{28}
25 75 2.4 \times 10^{23}
10 90 1.7 \times 10^{13}
5 95 7.5 \times 10^{7}
1 99 1.0 \times 10^{2}
0 100 1
Total: 1.27 \times 10^{30}

gives

\Delta S=\left(1.38 \times 10^{-23} J / K \right)\left[\ln \left(1.0 \times 10^{29}\right)-\ln \left(1.4 \times 10^{28}\right)\right]                  (15.70)

=2.7 \times 10^{-23} J / K

Discussion
This increase in entropy means we have moved to a less orderly situation. It is not impossible for further tosses to produce the initial state of 60 heads and 40 tails, but it is less likely. There is about a 1 in 90 chance for that decrease in entropy (-2.7 \times 10^{-23} J / K) to occur. If we calculate the decrease in entropy to move to the most orderly state, we get \Delta S=-92 \times 10^{-23} J / K. There is about a 1 in 10^{30} chance of this change occurring. So while very small decreases in entropy are unlikely, slightly greater decreases are impossibly unlikely. These probabilities imply, again, that for a macroscopic system, a decrease in entropy is impossible. For example, for heat transfer to occur spontaneously from 1.00 kg of 0ºC ice to its 0ºC environment, there would be a decrease in entropy of 1.22 \times 10^{3} J / K. Given that a ΔS of 10^{-21} J / K corresponds to about a 1 in 10^{30} chance, a decrease of this size (10^{30} J / K) is an utter impossibility. Even for a milligram of melted ice to spontaneously refreeze is impossible.

Related Answered Questions