When you are doing Machine Learning you should always have a simple baseline and only use more complicated algorithms when they improve over your baseline.
That's my #3 question in a nutshell. And this seems to be a rather good strategy imo. However, the way everyone is talking about ML makes it seem as a diamond bullet to solve all that is holy and sacred!