As someone else from the UK, we're so far removed from anything that the Romans did that I doubt anyone has an emotional response to it (as you point out). I wouldn't even consider it correct to say that we're ethnically or culturally the same people as those who were subjugated under the Roman empire considering the subsequent Anglo-Saxon and Norman conquests!

In fact, it's hard for me to name something explicitly that the Romans did in Britain other than lay the foundations for some towns and cities, and built some roads. All of this was over 1000 years ago, so I doubt (other than the exceptions that I can think of on the spot; some roads, towns and 'Roman Baths') that anyone from the UK is walking around and interpreting what they see as a result of Roman occupation.

On an objective level as someone who obviously never experienced true Roman Britain, sure, they built some things that were pretty cool at the time, but at the same time you can objectively look back and say "yeah, slavery is really bad, I wish the Romans didn't enslave people and use that slave labour to build the things that they did". I think the real layman answer is "who cares, it was over 1000 years ago, and I don't really understand how the people of the time relate to the world/culture I take part in".