Top Books on Amazon Based on Links in Hacker News Comments
ramiro.org
ramiro.org
Nonetheless, this is an awesome project.
The beauty of open code is others can help improve it
I'd read Schild's Ladder prior to reading Permutation city, which is also a good read. It does seem to get bogged down in the technical and descriptive side of things at times, however, it's a fantastic idea for a story. The main premise of the film would make a great movie.
Whilst I'm on the subject of good "Hard sci-fi" novels, Tau Zero is also worth reading.
Edit - I'll also throw this in: http://www.amazon.co.uk/gp/product/0814703259
Magic :-)
"Since the Introdus in the twenty-first century, humanity has reconfigured itself drastically. Most chose immortality, joining the polises to become conscious software. Others opted for gleisners: disposable, renewable robotic bodies that remain in contact with the physical world of force and friction. Many of these have left the solar system forever in fusion-drive starships.
And there are the holdouts: the fleshers left behind in the muck and jungle of Earth—some devolved into dream apes, others cavorting in the seas or the air—while the statics and bridgers try to shape out a roughly human destiny."
Egan's books have been some of the most thought-provoking I've ever read as far as science fiction technology. A lot of the works were out of print until recently; I'm glad to see there's been a resurgence of interest in his writing, and the availability of his works.
http://www.amazon.com/Schilds-Ladder-Novel-Greg-Egan/dp/1597...
Although it's more like Schild's Ladder than Permutation City, I suppose. (Physics ideas rather than computation.)
I'm curious: after performing NET on the corpus, how did you filter to find books only? Did you just search on Amazon's catalogue for exact matches, or was more tweaking required?
So did you use some manual review step to remove these?
(Note: I'm not an expert in NER/NLP, so please correct me if I have got something wrong!)
$ host www.hnreads.com
www.hnreads.com is an alias for global-nossl.fastly.net.
global-nossl.fastly.net has address 23.235.44.204https://news.ycombinator.com/item?id=10440502
At 4 GB, I'd just as soon query this locally, but this looks like a fun exercise.
I notice that there were 10,729 distinct ASINs out of 15,583 Amazon links in 8,399,417 comments. Since I don't generally (ever?) post Amazon links, I'd be interested in expanding on this in two ways.
First, I'd reduce/eliminate the weight of repeated links to the same book by the same commenter.
Second, I'd search for references to the linked books that aren't Amazon links. Someone links to Code Complete? Add it to the list. In a second pass, increment its count every time you see "Code Complete," whether it's in a link or not.
This requires scraping all the Hacker News data manually, for which I have a tool to do so (https://github.com/minimaxir/get-all-hacker-news-submissions...) which I mentioned in the post you linked, but it still requires a significant amount of time to get/process the data, hence why the BigQuery dataset has a significant advantage.
So this would require some form of sentiment analysis and also require book titles to be uniquely identifiable.
...but the counts might be low enough to manually check for those instances. I'm surprised the counts are so low.
To do such an analysis I'd need to download all 8M comments and process them individually and find a good way to detect book titles.
True, but they read it. Which is a testament to its popularity.
If the list were treated like a New York Times Best Sellers list and not a testament of absolute quality, mentions would be sufficient.
Yes, it looks like at least 14 of the "The Rent Is Too Damn High" links seem to come from the user "jseliger":
https://www.google.com/?gws_rd=ssl#q=site:news.ycombinator.c...
"Amazon is often the goto website for referring books, but many books have dedicated homepages as well as pages pages on their publisher's website. Moreover, many freely available are referred frequently in comments, but are not considered in this ranking."
The approach used here has limitations, I hoped to make that clear by pointing them out and choosing titles and headlines accordingly.
It is not the best when it comes to explaining things in an intuitive manner. It is a great reference book with lots of algorithms and proofs.
In recent years I have been drawn more towards Levitin's "Introduction to the Design and Analysis of Algorithms".
Anyone else have similar feelings about "Introduction to Algorithms"?
If I really want to understand something like max flow-min cut, I'll turn to "Algorithm Design" by Kleinberg and Tardos, which often has a much more intuitive explanation for concepts(imo).
While the "War Story" section in Skiena's book gave a great perspective of application of the theory.
I loved The Algorithm Design Manual. Used it for my class as well as preparing for technical interviews. Although looking back at it now, TADM is great for learning algorithms (quickly) for the very first time, while CLRS is a good reference manual once you already understand how they work.
https://twitter.com/mattyglesias/status/689169613779808257 "The only book ranking that matters"
Is this a result of the author spamming his own work?
Edit: Looks like it, short skimming of "darwin's theorem site:news.ycombinator.com" shows that all links are from user tjradcliffe, who is the author. A case for manual curation of data.
Code: The Hidden Language of Computer Hardware and Software by Charles Petzold (http://amzn.com/B00JDMPOK2)
It really is outstanding.
I wrote this curated site from HN several years ago. Got tired of people continuously asking for book recommendations. http://www.hn-books.com/
Couple points of note. This is 1) an example of a static site, 2) terrible UI, 3) contains live searches to comments on each book from all the major hacking sites, and 4) able to record a list of books that you can then share as a link, like so (which was my reason for making the site)
"My favorite programming books? Here they are: http://www.hn-books.com#B0=138&B1=15&B2=118&B3=20&B4=16&B5=1... "
I started writing reviews each month on the books, but because they were all awesome books, I got tired of so many superlatives!
Thanks for the site.
Basically a Hackernews for books.
http://www.amazon.com/The-Rent-Too-Damn-High-ebook/product-r...
It's the most polarized I've ever seen in my life.
I've considered building the same myself. It would be lovely if you tracked the various HN reader client apps. A few that come to mind are: Hacker News Enhancement Suite for Chrome [1], Hacker Menu for OS X [2], and Premii's HN web app [3].
1: https://chrome.google.com/webstore/detail/hacker-news-enhanc... 2: https://hackermenu.io/ 3: https://hn.premii.com/
E.g:
- SICP: Structure and Interpretation of Computer Programs
- CTM: Concepts, Techniques, and Models of Computer Programming
- TAOP: The Art of Prolog
If you share the numbers, that's a bonus. All HN readers love more data!
I have no issue with people doing this, as long as their posts are not solely motivated by wanting an excuse to post their affiliate link. I guess the more popular you get, the more likely that is to happen.
[1] http://blog.codinghorror.com/our-brave-new-world-of-4k-displ...
I even contemplated blogging about the above products with no interest in making money because I like the products that much. I have feeling Jeff was thinking along those lines as well and not to make money.
I just never understand people's hatred for affiliate links in good pieces of content.
EDIT: This is not the case with the posted article: see clarification below.
Personally I thought this was an awesome use of the dataset and introduced me to some new books I hadn't considered.
In this case, yes, the content is good and the intent was not to drive visits to Amazon. (in contrast with a hypothetical post like "Top 10 Books You Should Buy To Be Smart According To The Nerds at Hacker News.") Sites/Medium posts have been trending toward the latter model of revenue generation in the face of declining ad revenue.
1) sure, there was effort put into this and it likely wouldn't have been made w/out affiliate links, so clearly there's value provided.
2) it's pretty clear that a list like this is going to underrepresent books where an amazon link is less likely --- superior free alternatives to the books listed in some cases. Using affiliate links (and, as far as I can tell, only undisclosed affiliate links) suggests that getting an accurate "top 30" wasn't the highest priority.
So the affiliate links are a signal of intent, and intent affects accuracy in this case. But the list wouldn't have been written otherwise.
"You've figured out a way to post native content advertising to Hacker News" would be the equally uncharitable counterpoint to your mock quote.
But the list was explicitly generated from Amazon links... wasn't that always going to be the case?
Tagging the links was a conscious decision, but I do think that the approach of looking for Amazon links provides more insight than any other domain/online store.
It's not super clear from the website whether this is something you did primarily to learn about data analysis, learn about HN's book recommendations, or to make money. Any of those is fine! But the motivation is likely to influence the outcome (even unintentionally) and it's something that could be made more clear.
I'd actually like an answer. I have no problem with the affiliate links at all (though the listicle-like gallery presentation is awkward on mobile), and would legitimately like to know if there are any real-world examples of affiliate links making money when targeting a specific community. I had affiliate links all over (organically, not in ad form) when I ran a popular SharePoint community, and I think I made ~$300 total in the year I had the links active. HN "feels" like a larger community than my old SharePoint community was, so the answer to My GP's query is interesting from an academic sense.
[2] https://gigaom.com/2013/02/14/the-brainpickings-brouhaha-and...
"How dare you build a side project and attempt to offset the costs of hosting and a domain?"
The list:
"The Rent Is Too Damn High: What To Do About It, And Why It Matters More Than You Think" by Matthew Yglesias
Publisher: Simon & Schuster
"The Four Steps to the Epiphany: Successful Strategies for Products that Win" by Steven Gary Blank
Publisher: Cafepress.com
"Introduction to Algorithms, 3rd Edition" by Thomas H. Cormen
Publisher: The MIT Press
"Influence: The Psychology of Persuasion, Revised Edition" by Robert B. Cialdini
Publisher: Harper Business
"Peopleware: Productive Projects and Teams (Second Edition)" by Visit Amazon's Tom DeMarco Page
Publisher: Dorset House Publishing Company, Incorporated
"Code: The Hidden Language of Computer Hardware and Software" by Charles Petzold
Publisher: Microsoft Press
"Working Effectively with Legacy Code" by Michael Feathers
Publisher: Prentice Hall
"Three Felonies A Day: How the Feds Target the Innocent" by Harvey Silverglate
Publisher: Encounter Books
"JavaScript: The Good Parts" by Douglas Crockford
Publisher: O'Reilly Media
"The Little Schemer - 4th Edition" by Daniel P. Friedman
Publisher: The MIT Press
"The E-Myth Revisited: Why Most Small Businesses Don't Work and What to Do About It" by Michael E. Gerber
Publisher: HarperCollins
"Feeling Good: The New Mood Therapy" by David D. Burns
Publisher: Harper
"Programming Collective Intelligence: Building Smart Web 2.0 Applications" by Toby Segaran
Publisher: O'Reilly Media
"The Non-Designer's Design Book (3rd Edition)" by Robin Williams
Publisher: Peachpit Press
"The C Programming Language" by Brian W. Kernighan
Publisher: Prentice Hall
"The Design of Everyday Things" by Donald A. Norman
Publisher: Basic Books
"Cracking the Coding Interview: 150 Programming Questions and Solutions" by Gayle Laakmann McDowell
Publisher: CareerCup
"What Intelligence Tests Miss: The Psychology of Rational Thought" by Keith E. Stanovich
Publisher: Yale University Press
"On Writing Well, 30th Anniversary Edition: The Classic Guide to Writing Nonfiction" by William Zinsser
Publisher: Harper Perennial
"Darwin's Theorem" by TJ Radcliffe
Publisher: Siduri Press
"Knowing and Teaching Elementary Mathematics: Teachers' Understanding of Fundamental Mathematics in China and the United States (Studies in Mathematical Thinking and Learning Series)" by Liping Ma
Publisher: Routledge
"Don't Make Me Think: A Common Sense Approach to Web Usability, 2nd Edition" by Steve Krug
Publisher: New Riders
"Expert C Programming: Deep C Secrets" by Peter van der Linden
Publisher: Prentice Hall
"Clean Code: A Handbook of Agile Software Craftsmanship" by Robert C. Martin
Publisher: Prentice Hall
"The Elements of Computing Systems: Building a Modern Computer from First Principles" by Noam Nisan
Publisher: The MIT Press
"Code Complete: A Practical Handbook of Software Construction, Second Edition" by Steve McConnell
Publisher: Microsoft Press
"The Box: How the Shipping Container Made the World Smaller and the World Economy Bigger" by Marc Levinson
Publisher: Princeton University Press
"Software Estimation: Demystifying the Black Art (Developer Best Practices)" by Steve McConnell
Publisher: Microsoft Press
"Refactoring: Improving the Design of Existing Code" by Martin Fowler
Publisher: Addison-Wesley Professional
"Design for Hackers: Reverse Engineering Beauty" by David Kadavy
Publisher: WileySICP gets mentioned a lot too.
As a side note, the failure of both of us to actually mention the book's full title (or include its amazon link) presumably means that neither of the services being discussed would have registered this as a vote for the book. We're part of the problem! ;)
On https://reddit.com/r/bigquery, /u/omicron_n2 left queries to repeat the experiment on HN and on reddit comments too:
- https://reddit.com/r/bigquery/comments/41py1v/top_30_books_o...
And a presentation by /u/Pentium10 on the same topic, using the books that redditors read:
- http://www.slideshare.net/martonkodok/complex-realtime-event...
I admire the effort. Calling it Top Books is slightly misleading. Perhaps you can call it, most mentioned books.
It is sad that someone published this crap and killed thousands of trees. Do you know how long it will take to regrow those trees? 20-30 years. Your selfish lust for money lead you to get up all your principals.
SHAME.Always interesting to read. But just as interesting is how quickly they pop to the top of the home page.
Here's one on understanding the mindset of your investors when raising startup capital - Startup Wealth - http://amzn.to/1Jej8El
Not where I live. What to do about it? Move. Find an employer willing to let you work remotely, and find your own quiet cost-conscious piece of paradise.
Too few companies offer remote, because remote is hard. My experience at Stack is that remote work really only happens when a company supports it “natively” from the start. It’ll take a generation to make a dent, sadly. I’d like to be wrong.
Some of us like living in the city :(.
The demand for urban living outpaces supply of urban housing the United States. We need a great urban housing expansion throughout the country to make city living affordable again.
I've always been intending to read "The Human Zoo":
"How does city life change the way we act? What accounts for the increasing prevalence of violence and anxiety in our world? In this new edition of his controversial 1969 bestseller, The Human Zoo, renowned zoologist Desmond Morris argues that many of the social instabilities we face are largely a product of the artificial, impersonal confines of our urban surroundings. Indeed, our behavior often startlingly resembles that of captive animals, and our developed and urbane environment seems not so much a concrete jungle as it does a human zoo. Animals do not normally exhibit stress, random violence, and erratic behavioruntil they are confined. Similarly, the human propensity toward antisocial and sociopathic behavior is intensified in todays cities. Morris argues that we are biologically still tribal and ill-equipped to thrive in the impersonal urban sprawl. As important and meaningful today as it was a quarter-century ago, The Human Zoo sounds an urgent warning and provides startling insight into our increasingly complex lives."
http://www.amazon.com/The-Human-Zoo-Zoologists-Kodansha/dp/1...
If you've read this book, do yourself a favor and read some refutations. Or do one better, and learn economics so you can think about these issues clearly.
http://www.amazon.com/Economics-One-Lesson-Shortest-Understa...
The Four Steps to the Epiphany: Successful Strategies for Products that Win
Author: Steven Gary Blank
Publisher: Cafepress.com
Number of links: 45Can we get the top 100 books as well? (since many of those would have very similar mention numbers as the end of the top-30)
Thanks for the list though. Bought the psychology one.
Extremely annoying.
At some point someone with a megaphone encouraged their listeners / viewers to brigade the book with bad reviews. They did so and the low star count is the result.
I'm trying to Google for details over the brouhaha but can't find the correct keywords.