If the result of telling coworkers is so undesirable, why not keep it between yourself and your immediate manager?
In fact keeping the amount secret can actually make problems worse, by encouraging people to use their imagination to answer the question; then you end up with a situation where you actually got an extra $5K/year, but everyone you work with thinks you got an oil tanker full of Spanish doubloons and a stable full of ponies.