You assume that one knows that the place where you're going is beyond the reach of cellular service before one even goes there.
I like having OSM sometimes for, like, figuring out parking and trails in parks, but I've never succeeded using it to get directions on roads.
Any time I'm driving somewhere reasonably far (or where I know there's no service), I'll download or update the maps. Never had an issue.