1) turn off a light in the app
2) physically disconnect and reconnect power to a light (e.g. unplug and plug in)
3) note that light is on by default (at least for Hue lightstrips, not sure about others)
4) note that you cannot turn the light off without turning it on in the app
However, are you sure about 4?
I had power outages sometimes, when the power comes back, all the hue lights gets on (Not cool when it's 4 am by the way), but then I'd just press "Off" on my hue light app and they'd all turn off.
If I remember the Hue API, you can send a new state to the lights not matter what the previous state was, so I'm not surprised this works correctly, which is why I'm confused about your step 4).
Are you trying to turn them off via a Echo command specifically?
I suspect that even the vanilla Hue app on Android does that - given the way I often manage to switch the lights before the app UI figures out what's their current state.
--
4) is not true, I just tested it. If I leave the app open it does take a few seconds to sync. If I close the app and reopen it, it displays the correct status. This is using the official Phillips app. Some other apps may not read the status, but they clearly could.