I have in my router options possibility to choose what Gz should device connect to: for example, old notebook I connect to 2.4 only. Maybe you should enable same for homepod?