It is not in fact close to zero, it is significant inflation, particularly as they tend to float over the target (3-4%).

At 2% over just 25 years money loses 60% of its value. That is not insignificant, and of course with higher rates it loses value quicker.