Ok I'm actually going to delete my web site and cloudfront distribution over this. It gets no traffic (at the moment).
The bucket is the same name as the domain so I can imagine this could be exploited quietly very easily as PUTs are so expensive.
Literally a $5 VPS could cost someone $1k.