Does Caddy support generating HTML files? I use Hugo for a few websites that I host on S3 + CloudFront and am very happy with AWS handling the back-end part this stack, and wouldn't want to switch to a server that I would now need to manage.
If your workflow with static files cached by a CDN already works for you, then this is probably not going to help you.