Machine Learning: A Summary on Feature Engineering Using R Language
blogs.msdn.microsoft.com
blogs.msdn.microsoft.com
But in linear fitting, over fitting is simpler: There, of course, do get a linear function which doesn't go wild. And the function can fit the data nicely. The usual problem is that the coefficients in the linear function are not unique.
"On the same note, though perfectly correlated variables are redundant and might not add value to the model (and if removed, would be computationally efficient), a high-variable correlation could have additional information to add. In other words, two variables that are not correlated could still be of importance to the model. When in doubt, it’s safer to train the model and observe it’s performance."
The "In other words" part seem to talk about uncorrelated variables while the sentence before that talked about highly correlated variables. I always thought to discard one of two variables that were highly correlated.
The bit about "it's safer to train the model and observe its performance", though, is reasonable advice. The main problem with multicollinearity is that it gives you a model with poorly-defined coefficients - that is, their standard errors are high. That's a big problem if you're coming at the problem with a statistician's mindset and trying to come up with a parsimonious model with statistically significant parameter estimates. If you're just going for the best predictive model you can get, though, then you don't necessarily care about super tight standard errors on all your coefficients, so it's not such a big deal.
Just cause it's specific to microsoftR and the package doesn't mean those algorithms are own by microsoft. You just have to google other packages that have those algorithms. All of them are just statistic... R have tons of statistic package more than Python. I will be highly skeptical if you can't find a LDA, PCA, etc.. in a package somewhere.
The only important part here is the technical knowledge of what it are these algorithms for and when to use them and when not to.
I didn't say you can't do this with standard R. I didn't say they invented or own anything.
Are you kidding me? You're telling me they're embracing it and not trying to get into the ML share or playing catch up ever since Hadoop came about?
> This seems specific to Microsoft R or can I install the MicrosoftML package in regular R and/or use it under Linux?
You asked a question and I provided an answer. Just cause you didn't like it doesn't mean it's not an alternative to Revolution R. You're just taking it as if it's some attack on you, grow up. I'm stating that if it's not possible then you can always find package for it. They're statistic algorithms that you learn in stat grad courses and R is a statistic language. So you can find it if you can't use Microsoft stuff. So you don't have to worry if it works or not.
I also don't get this fascination on this library. You can just use packages that is agnostic to what R version (R Revolution microsoft or regular R).
They're trying to sell their version of R and hopefully their cloud stuff like Azure.
> The arrogance is visible in the title that doesn't mention it's specific to MS R.
I have no idea what that mean.
All the mx prefix functions are Revolution R only.
I'm interesting in how they are made though.