Could you elaborate (or link to a framework) for doing the server generated HTML on Lambda?
If you're interested, I use https://middy.js.org/ as a middleware engine for my AWS lambda functions which I find helpful.
I use the open sourced serverless framework for doing deploys https://www.serverless.com/ though I'm probably going to move to using AWS SAM in the future.