If my Alexa fails, then I can also just turn the light off with the switch and when flipped back "on" again, then it will be on.

Fallback to 'classical mode' works for me.