HNHacker News
TopNewBestAskShowJobs

solidrocketfuel

80 karma · joined January 7, 2016

submissionscomments
solidrocketfuel··on The Three Cultures of Machine Learning
a) perhaps "feature engineering" was not the right 2-gram. I was looking for the (cultural) difference in approaches. Logic programming starts with background knowledge, predicate logic, and hand-written rules on what is valid and what isn't. Deep learning is trying to learn this bottom-up. When DL finds a rule or fact it did so from data, not by using any pre-defined rules or facts.

b) if we apply hierarchical clustering, it would probably be a subset.

Anyway, this was more or less tongue-in-cheek. And yes, you could go on and on. I should have added "The Logicians", "The Game Theorists" and the NLP'ers solving object detection problems with visual bag-of-words. Also forgot to take a jab at business intelligence/operations research.

As for being wedded to a favorite technique, I think that is largely a problem for beginners (and PhD. students with a supervisor who can only think from within a certain framework). I myself may try SVM, but I rank it pretty low as an alternative.

solidrocketfuel··on The Three Cultures of Machine Learning
The Geneticists: Use evolutionary principles to have a model organize itself

The Bayesians: Pick good priors and use Bayesian statistics

The Symbolists: Use top-down approaches to modeling cognition, using symbols and hand-crafted features

The Conspirators: Hinton, Lecun, Bengio et al. End-to-end deep learning without manual feature engineering

The Swiss School: Schmidhuber et al. LSTM's as a path to general AI.

The Russians: Use Support Vector Machines and its strong theoretical foundation

The Competitors: Only care about performance and generalization robustness. Not shy to build extremely slow and complex models.

The Speed Freaks: Care about fast convergence, simplicity, online learning, ease of use, scalability.

The Tree Huggers: Use mostly tree-based models, like Random Forests and Gradient Boosted Decision Trees

The Compressors: View cognition as compression. Compressed sensing, approximate matrix factorization

The Kitchen-sinkers: View learning as brute-force computation. Throw lots of feature transforms and random models and kernels at a problem

The Reinforcement learners: Look for feedback loops to add to the problem definition. The environment of the model is important.

The Complexities: Use methods and approaches from physics, dynamical systems and complexity/information theory.

The Theorists: Will not use a method, if there is no clear theory to explain it

The Pragmatists: Will use an effective method, to show that there needs to be a theory to explain it

The Cognitive Scientists: Build machine learning models to better understand (human) cognition

The Doom-sayers: ML Practitioners who worry about the singularity and care about beating human performance

The Socialists: View machine learning as a possible danger to society. Study algorithmic bias.

The Engineers: Worry about implementation, pipe-line jungles, drift, data quality.

The Combiners: Try to use the strengths of different approaches, while eliminating their weaknesses.

The Pac Learners: Search for the best hypothesis that is both accurate and computationally tractable.

See also http://www.kdnuggets.com/2015/03/all-machine-learning-models...

> It is common for people to learn about machine learning within one framework which often becomes there "home framework" through which they attempt to filter all machine learning. (Have you met people who can only think in terms of kernels? Only via Bayes Law? Only via PAC Learning?) Explicitly understanding the existence of these other frameworks can help resolve the confusion.

solidrocketfuel··on Scientology says it's received $5.7M from Google in ad grants
Youtube shows religious advertisements to children.

Youtube removed "related content" videos section for official Scientology material. This censors critique videos and breaches the principle that Google was founded on:

- To offer a search engine in the academic domain, where ranking is not decided by advertisers, but by link-weighted popularity.

As a comparison: A mobile phone manufacturer pays Google to remove the "related videos" for their videos, because one of those related videos talks about the dangers of driving while using a mobile phone.

Youtube embeds content hosted by Scientology on their Youtube profile page. This gives the Office of Special Affairs the IP (personal information) in their visitor logs. Scientology also places a cookie while surfing on the Youtube site. No confirmation is asked.

Scientology gets around the "all comments vs. no comments at all" by removing any negative or critical comment, and only allowing positive and astroturfing comments.

Even though religious advertisements used to be against their policy, they have since then taken money from religious institutes.

Advertisements are against Adwords TOS, when:

- Sites with content that incites or promotes hatred against a group or individuals.

- Content that encourages others to believe that a group or individual is inhuman or inferior

Scientology.org has content that promotes hatred against medical professionals. They vilify doctors for prescribing drugs for ADD. Factual quality of the content is low, while impact on the life of someone who believes all information there is high.

There is freedom of speech, and there is suiting advertisers. Google really needs to refind their balance. And be consistent in enforcing the rules, for instance their link-farm makes blackhat SEO's pale.