If you want the updated site to be available immediately then you must invalidate the cache.
I do it as the last step in my CI/CD process:
- aws configure set preview.cloudfront true
- aws cloudfront create-invalidation --distribution-id $CLOUDFRONT_ID --paths '/*'
- curl https://google.com/ping?sitemap=$SITEMAP_URL