This is especially prevalent when people don't anticipate the overhead of the technical aspects needed to finish some business functionality.
And yet, when my estimates are large people look at me odd and try to peer pressure me into not being an outlier.
In the end, however, there's certainly a sort of multiplier for working with legacy code or overcomplicated systems.
It doesn't have to be. You can learn to give estimations of the "there's a 90 % chance this will be done before date X" and then when you look back at your 50 last projects, roughly 45 of them indeed were done before your estimated 90th percentile point.
Granted, the process will still look like plucking numbers out of the air, but the result will be more meaningful for planning than numbers actually plucked out of the air.