It also means giving up vision which I don't know how I would deal with. I think I would prefer a weaker model with vision than a stronger without.
Because you would have to switch model.
You can't just say "Oh, button X looks weird see [screenshot]" while coding with GLM. You would need to switch to another model and then maybe back.