All the books I’ve bought for my kindle have a “bought by mistake? Press here” thing which instantly removes and refunds it.
Nevertheless, why on earth would it allow the purchase to happen when it was set to deliver to a specific unsupported kindle, my only one? It just makes no sense other than as a scam.