So what? The company still generated the VAT revenue.

The customer gets a refund, but has to charge their own customer VAT on the full amount of the goods they are selling, so the VAT accumulates until it is paid by someone who cannot claim the VAT back

That's why it's called "value added tax" - each supplier in the chain generates VAT on the value they add.