Is this like a simple version of Google Vizier-style blackbox optimization?
There are plenty of ways to optimize models from evolutionary algorithms to bandit models, in my simple case I'm working with limited resources, so I included a wrapper to a global bayesian optimizer for sequential search. Grid search is out of the question, but the tool is still handy if I want to freeze all the parameters and vary a couple of them to study some aspect.
bonus: the parameter space file is a nice way to document my experiments --I can track exactly how each experiment was configured.