A retailer would be irrational to let stock run out instead of continuously raising prices.
But retailers have studied that this trick isn't going to last because not everyone wants to buy candy bars in bulk, and they won't spend more than $3 for a single candy bar, which means if it goes any higher they won't by any candy bars at all.