I think I ended up using "WP Static HTML Output" (not sure how to make the link citations here on HN, but the URL is https://wordpress.org/plugins/static-html-output-plugin/ ) because it exports to S3, which is where I was hosting the static sites.