Simply tell your friends “I’m afraid I can’t commit to meeting you at any time due to my inadequate executive function”. It should help them change their viewpoint.
"How about I meet you at your place? I often run late and would rather you weren't sitting there waiting for me"
Or you could pick me up at my work; I'll already have to be dressed and out of the house since I'm at work.