Sounds interesting! I'm a bit confused about how can you profile the system's performance automatically? If I understand correct, the profiling process needs a client to mock real requests in production environment, and the client of serving Deep Learning models are various from one to another.