Vinegar is an acid, so it tastes sour. Ditto citrus fruits.
Bases taste bitter and feel slippery.
Human bodies are usually capable of dealing with quite a lot of acid or base coming in through the digestive system. I really don't know what sort of "risk" you're talking about.