Dalton and even Lazenby actually hold up quite well. Perhaps it has more to do with the script and directing than the actor. The films of these least "successful" Bonds are among the best Bond films, and far better than the worst outings by Craig, Brosnan, Moore and even Connery.
Dalton was an odd fit for Bond, though I've enjoyed his work elsewhere.
Unpopular, but defend-able. Preferring Pierce Brosnan on the other hand...
Brosnan is the Bond of my generation. I loved Golden Eye, but I think the later films were just bad, not because of the actor(s) but because of the script and plot.