What makes you say that? After some months or years of finding Mars and Jupiter in the sky it became second nature to me. You can just judge the time, don’t need a clock, look up at the sky and spot things immediately. If you’ve been practicing every day for a long time why not?
Yes they also move in the sky but you get that too. You’ll think, oh it’s April and 11pm, I know where mars is instinctively.