Would kubernetes be too much overhead? That would be able to meet all of your needs.