I remember using GAs to tune SVM kernel hyperparameters a few years ago. They worked well enough, but I mostly did it because I was lazy.

It's been looked into. I'm really struggling to remember who was doing the looking though, but it exists.

If you have the horsepower to test a population of deep nets, then absolutely.