Also you're unlikely to see the owner, they certainly won't be inside with you, you can leave any time, you're likely to be with others, and they can't change your location.

Contrast that with an intoxicated young woman climbing alone into a stranger's car where he has a lot of control - including being able to lock the doors or take her to a remote/unfamiliar location. Even with all the checks and measures in place, assaults are not uncommon; I'm not familiar with any AirBnB type assaults (far more frequently, it's the guests victimising the owner via property damage).