David J.C. MacKay, Machine Learning pioneer, dies
itila.blogspot.com
itila.blogspot.com
I saw David only rarely after leaving the group to do my PhD, and hadn't in years before I saw him at a group reunion last month. I'm saddened that I passed on so many opportunities to learn more from him.
[*] David was still teaching us information theory just last month, despite going through chemo which by his admission seemed to take a lot out of him. By everyone's account he was astounding lecturer. He really cared that no one fell behind. Very sad about the news today.
"Sustainable Energy - without the hot air" (http://www.withouthotair.com/) does the sums on sources of sustainable energy, to try to establish whether they present a realistic alternative to fossil fuels. It might make sense to read this as a companion to Bret Victor's "What can a technologist do about climate change?" (http://worrydream.com/ClimateChange/), though MacKay's book mostly doesn't talk about climate change but about fuel exhaustion.
"Information Theory, Inference, and Learning Algorithms" (http://www.inference.phy.cam.ac.uk/mackay/itila/) is a readable and charming (but mathematical) book that touches on a lot of topics in information theory. A lot of it is over my head, but I most recently referred to it just a couple of weeks ago for its chapters about the mathematics of neural nets, including a chapter given to estimating the information capacity of a single neuron.
He was only 48 and had stomach cancer, which he wrote about on his blog (http://itila.blogspot.co.uk/).
http://itila.blogspot.de/2016/04/index-for-first-23-cancer-c...
His donation page: https://www.justgiving.com/davidjcmackay?utm_source=email&ut...
How he dealt with his illness: http://itila.blogspot.gr/2016/01/bye-bye-chemotherapy-hello-...
You can read it free online - I like the print copy though! (It's for the UK, but has lots of useful referenced data for anywhere)
I met him a few times in Cambridge trying to organise a campaign about Climate Change. He was passionate and fun. Sad that I never really delivered for him.
Rest well David, combining a scientist's accuracy and detail with a human's care for the world.
News of his passing deeply saddens me.
It's deeply saddening that someone who has had a significant positive impact on the UK - as an advisor to the government - and world, won't be able to continue to make more positive impacts. I imagine it would be hard for someone to fill the gap that has been left by him.
It's a huge testament that right now now I can see 3 different copies of Information Theory, Inference, and Learning Algorithms sitting on 3 different desks in our office. He will be missed :(