I experienced this with Lambdas behind a VPC, and yeah it's completely crazy. This is true with the DB offerings as well?
I don't see what the use case is then. Intermittent background jobs or something?
In my experience 20s is good sadly - quite often the cold start is longer than the max timeout for a lambda function, so my app always shows an error when woken up.