If you’re doing traditional on-site interviews, you’re already asking for multiple days (unless they live nearby).
It can be a challenge sometimes, but not as often as you might think.
I’m sure there are heavy-handed employment contracts that prohibit side work, but hasn’t been a problem in practice.