This is very cool. Sorry if I missed it (poked around the site and your GitHub repo), but is the script available anywhere for others to run?
Would love to publish results of running this against a series of ~10-20 open-source models with different quantization levels using Ollama and a 192GB M2 Ultra Mac Studio: https://github.com/jmorganca/ollama#model-library