|
There is a simple equation that defines entropy. Chemical Engineers make use of the term to describe the behavior of substances. We use it, for example, to evaluate the performance of a steam turbine. It has been misused by zealous promoters to obfuscate information.
|
|
|
|
|
And that simple equation is?
|
|
|
|
|
|
|
Been a while but I don't think that is the same thing as entropy in information theory.
But perhaps are related.
|
|
|
|
|
|
|
Entropy is an attempt to give a macroscopic number that describes a large number of microscopic states. Taking the "classic" deck of cards, there is only 1 way of arranging the cards in suit order (Clubs, Diamonds, Hearts, Spades) in increasing order in each suit (2, 3, ..., J, Q, K, A). We take the log of the number of states, and the entropy is 0.
If the suits can be in any order, we have 4! possibilities, with an entropy of log(4!).
If the cards are in the order red-black-red-black, we have 26! * 26! possibilities, with an entropy of 2*log(26!).
If the cards can be in any order, we have 52! possibilities, with an entropy of log(52!). This is also the maximum entropy for the card system.
Each of the different ways to arrange the cards in the above examples is called a "micro-state". In physics/chemistry we usually multiply the entropy calculated above by Bolzman's constant, to fit it in with other units such as temperature, energy, etc.
The connection to information theory comes from the fact that the lower the entropy of the system, the easier it is to predict the next card.
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows.
-- 6079 Smith W.
|
|
|
|
|
Thank you very much for your answer. I will go through the card deck example and hope I will understand it in detail.
Anyway statements like Quote: Entropy is an attempt to give a macroscopic number that describes a large number of macroscopic states.
makes it hard to understand. What exactly 'macroscopic' and 'macroscopic' means....
|
|
|
|
|
The second 'macroscopic' should have been 'microscopic'.  Corrected in the original.
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows.
-- 6079 Smith W.
|
|
|
|
|
Wait wait. Looks more I cited it wrong?
This chaos therory let me end in chaos 
|
|
|
|
|
Hi All,
Just a sign off for the year from work to you all :santa: (well he doesn't have an icon? ![Green Alien | [Alien]](https://codeproject.global.ssl.fastly.net/script/Forums/Images/alien.gif) could well be on the naughty list?). Happy whatever, Happy New Year!!!
|
|
|
|
|
And Happy Christmas to you, enjoy the break, and maybe a ![Beer | [beer]](https://codeproject.global.ssl.fastly.net/script/Forums/Images/beer.gif) or two.
|
|
|
|
|
| π
What do you get when you cross a joke with a rhetorical question?
The metaphorical solid rear-end expulsions have impacted the metaphorical motorized bladed rotating air movement mechanism.
Do questions with multiple question marks annoy you???
|
|
|
|
|
glennPattonWork3 wrote: That point when 'do it next year' is reasonable
The 2nd of January? 
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows.
-- 6079 Smith W.
|
|
|
|
|
Wordle 916 5/6*
β¬π¨π¨β¬β¬
β¬π¨π¨β¬π¨
π¨π©π¨β¬β¬
π©π©π©β¬π©
π©π©π©π©π©
|
|
|
|
|
Wordle 916 3/6
β¬β¬β¬β¬π¨
π©π¨β¬π¨β¬
π©π©π©π©π©
|
|
|
|
|
Wordle 916 3/6
π¨β¬β¬β¬β¬
β¬π¨π¨β¬β¬
π©π©π©π©π©
|
|
|
|
|
Wordle 916 3/6
β¬π¨β¬β¬π¨
π¨β¬π¨π¨π¨
π©π©π©π©π©
βThat which can be asserted without evidence, can be dismissed without evidence.β
β Christopher Hitchens
|
|
|
|
|
Wordle 916 5/6*
β¬β¬β¬β¬β¬
β¬π¨π¨π¨β¬
π¨π©π©β¬β¬
β¬π©π©π¨π©
π©π©π©π©π©
Happiness will never come to those who fail to appreciate what they already have. -Anon
And those who were seen dancing were thought to be insane by those who could not hear the music. -Frederick Nietzsche
|
|
|
|
|
π¨β¬β¬β¬β¬
β¬β¬π¨π¨β¬
β¬π©π©π©π©
π©π©π©π©π©
In a closed society where everybody's guilty, the only crime is getting caught. In a world of thieves, the only final sin is stupidity. - Hunter S Thompson - RIP
|
|
|
|
|
Wordle 916 3/6
β¬β¬π¨β¬β¬
β¬π©π¨β¬β¬
π©π©π©π©π©
Ok, I have had my coffee, so you can all come out now!
|
|
|
|
|
From CP newsletter.
Interpol operation arrests 3,500 cybercriminals, seizes $300 million[^]
"Another emerging scam tool is AI and deep fake tools to generate synthetic content that appears realistic to the targets or even the voice of a person close to them."
I have gotten a couple of calls where a person claims to have been arrested and they need bail.
Now there is no way I am going to fall for the gift card and meeting on a corner somewhere since I know exactly how bail works. But still if I know the voice on the other end that is going to get complicated. Since other scenarios where gift card and corner might apply (like a claimed kidnapping.)
I would probably still call the police.
But perhaps time to look into a 'key phrase' for the relatives. Or at least the ones that I would give money to in the first place.
|
|
|
|
|
Someone recently tried to phish me, and they had a human at the end of an 800 number as part of the scam.
Someone is paying for that number, so I reported it to the FBI.
It was pretty convincing if you missed a minor detail in the originating email, the same detail that got it through the google filters, and that was that it originated from a gmail address.
I don't want anyone falling victim to them, that's why I reported them.
/snitch
Check out my IoT graphics library here:
https://honeythecodewitch.com/gfx
And my IoT UI/User Experience library here:
https://honeythecodewitch.com/uix
|
|
|
|
|
fbi? good luck with that circus
Charlie Gilley
βThey who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.β BF, 1759
Has never been more appropriate.
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
