Hacker News Reader

Comment by jstx1 | Hacker News Reader

For me PCA is strictly in a bucket labeled "this comes up a lot in data science interviews but you never actually need to use it at work".

View on HN

You've never had to any kind of factor analysis in your work or done any searching for latent variables that map to customer/stakeholder question? Given the number of people I've worked with that are interested in modeling "engagement", I find this hard to believe.

PCA is an incredibly valuable tool that I've used in most jobs I've had. It's just a terrible idea as a default part of a feature engineering pipeline (which is what the author is talking about in terms of "feature selection"), for reasons outline in this article.

I suggest you don't be quite so quick to dismiss important concepts in this area, and before criticizing this post, at least read through it (I noticed your comment about misunderstand what the author is discussing by "feature selection" is the top comment here).

> You've never had to

Nope, never. I'm not dismissing PCA altogether; I'm sharing my experience and pointing out that some topics come up much more often in interviews than on the job.

My experience is the opposite of yours. It has never come up in a job interview but I have used it for real work several times.

For me the contents of this bucket are things like SVM, Naive Bayes, and k-means. PCA is actually in a slightly higher tier than those three.

k-means are actually useful for bootstrapping statistical mixtures when you don't have good priors.

Just for this convenient use alone I would place them above PCA.

What does bootstrapping statistical mixtures mean?

Why not just bootstrap in the regular old non-parametric way? Why inject k-means into it?

When you try to approximate your data with a mixture of distributions, say Gaussians for instance, you have to initialize their parameters with some values before running your EM loop.

Finding good ones can be very problematic. The k-means process is a reasonable method to get good enough starting values without having to think/compute too much.

https://en.wikipedia.org/wiki/Expectation%E2%80%93maximizati...

OK, so for you, "bootstrapping statistical mixtures" means "warm-starting EM mixture modeling".

Personally I never would have guessed that, in retrospect it makes sense... to each their own!

Reply on news.ycombinator.com