I agree that we can find broad agreement on the facts if we replace "free will" with baggage-free terms, but this still leaves open the question of what people actually mean when they hold someone responsible for a freely made choice, and whether this is justified. Under Compatibilism it is, but otherwise it mostly isn't.

In my experience, everyone arguing about brains and the universe is trying to justify something like the Consequence Argument, in which I think my insistence on a Compatibilist definition of free will is justified.