You can't protect your bucket with CloudFront if it's being access using S3 api.