S3 versioning could be pricey and painful. Try deleting a versioned bucket! I wrote a tool that I'm gonna open-source if my employer okays it, but the pathetic part is that you get charged for each HTTP request - imagine a bucket with a billion objects and a gazillion versions!
If you're not in a huge hurry to delete the bucket you can easily set lifecycle rules to expire all versions older than 1 day (the minimum) and then just wait for S3 to delete them for you.