Not just xylitol but also mastic gum, which, in addition to cavities prevention, kills H. pylori and strengthens your jaw muscles as it's a bit harder than regular chewing gum.
I used to have a (powerful-to-the-point-of-personal-uneasiness) corticosteroid that I would put on them to dubious effect, but I haven't needed to resort to that at all since I switched away from SLS toothpastes.