Actually, I managed to reproduce this. It was caused by upstream grpc connection pool (https://github.com/grpc/grpc-go/issues/9330). Fixing it now.