Yeah, those kind of circles would have been against the Nazi's even during the 1930's anyway.
There was a UK facist movement, and the Daily Mail newspaper(still going) ran the headline 'Hurrah for the Blackshirts', the blackshirts were the UK facists. It is a liberal joke to call them the 'Daily Heil' in return for this.
It just goes to demonstrate the absurdity of the idea of a country being good or bad. People are good or bad, not the rocks they stand on.
I don't know how close they were, but Hitler was clearly an admirer of the British Empire, and highly respected them (before the war broke out). He was led to believe that invasion of Poland would not cause France nor England to declare war on Germany (despite the existence of the alliances). Even after the war broke out, there were multiple cases where he tried to negotiate peace with the British Empire, but then Churchill was in power and was dead against the idea.