roimor

I'm referring to the entropy of the Bernoulli distribution. If the coin is fair, the entropy is 1 bit... if the coin isn't fair, then the entropy of the distribution is less than 1 bit. I'm having trouble reconciling the information theory way of thinking about entropy as a function of a distribution, with how physicists tend to think of entropy of arrangements.

I don't really understand this "Entropy Is All About Arrangements" takeaway. A fair coin has higher entropy than a biased one. What are the "arrangements" in this case?

I always read comments about how Twitter is not profitable. Any ideas as to how much of their revenue comes from ads vs. businesses paying for API usage?

How "open" is the Twitter API compared to other social networks such as Facebook, LinkedIn, etc... What is the lay of the land in this regard?

Is there something "bad" about journaling in a text editor and syncing that to dropbox?

Could you suggest some good introductory resources for getting into CA? Is there actually some systemic way of studying this stuff?