3) is true with all hue lights, so that you can easily override using the good old physical switches.

However, are you sure about 4?

I had power outages sometimes, when the power comes back, all the hue lights gets on (Not cool when it's 4 am by the way), but then I'd just press "Off" on my hue light app and they'd all turn off.

If I remember the Hue API, you can send a new state to the lights not matter what the previous state was, so I'm not surprised this works correctly, which is why I'm confused about your step 4).

Are you trying to turn them off via a Echo command specifically?