The sugar replacements might change your gut bacteria in the long term. You probably will not notice this for a long time until there are seemingly unrelated symptoms showing up.