You've been able to do this for a while now with CloudFront serving your S3 buckets - I'd suggest the few extra cents per month for the CloudFront CDN service is probably a better way of managing static Amazon hosted sites...
(curiously, the domain name I experimented with this on late last year is strangely appropriate here: http://www.damhik.com/ )