Why do these companies have the right to detain someone?
They are, of course, not going to go out of your way to remind you of that right when they say "please come with us".
If a non-law officer says “come with me”, you don’t have to, but people do it anyway.