About the issue on AWS Lambda, have you taken a look at other options such as Cloud Run or Fargate. I think they would better serve your use case.

Edit.

To be specific, the limit on runtime of the container. It is longer on the services I mentioned above.