Unfortunately, it will silently turn un-private after only six hours, so you need to be on top of that, lest you end up in the same boat. I learned this the hard way while listening to focus/study music all day at work.

Yeah it’s an option in settings. I always thought it was just to make your listening activity private from your followers, but maybe it does more.