My understanding is Schengen is about physical infrastructure and managing visas for third parties, and the EU about the actual rights for member state citizens. The UK was never in Schengen, and that meant that a French person coming to the UK could be stopped at the border, but they would be let through on the basis of rights enshrined in the EU.