Very intriguing and thoughtful statement. I hadn't ever thought of it that way.
Very intriguing and thoughtful statement. I hadn't ever thought of it that way.
E.g. if you have an N-layer neural network, N-1 layers are doing feature learning, and the Nth layer is a simple {logistic, multinomial/softmax, gaussian, poisson, ...} model
"The kernel trick avoids the explicit mapping that is needed to get linear learning algorithms to learn a nonlinear function or decision boundary."
(what powers Support Vector Machines, the neural networks of the 90s, and still alive and kicking today)
[1] https://en.wikipedia.org/wiki/Kernel_method#Mathematics:_the...
We sometimes get hung up on correcting and contradicting people, often missing a deeper truth. It takes skill to find the grain of truth and build on it :-)