The solution you're looking for is Docker. Gitlab distributes as a Docker image.