What you're actually proposing is to infer a distribution from a delta function. Or... something like that.