Of course, now you have the opposite problem: someone turns the bulb off with the lamp knob (unaware of/irritated with its smart features), and now it's unresponsive with all smart controls.

The best compromise are smart switches. Switch still manually controls the light, and smart features are always available. The downsides are that the lamp's outlet must have switch wiring, and smart switches aren't like normal toggles: they're more like push buttons so the switch isn't in a strange physical state.