This is where I see edge ai going. Minimal implementations running on embedded systems everywhere.
Full agree - this is where AI is finding it's main useful niche. Massive models are fun to use but specialization within embedded systems is the clincher.
Having AI running in every edge location poses an existential threat. They will provide the peripheral sensors for a larger intelligence.
Very cool showing the outputs of hyperparameter search. Hopefully this gets someone out of a tuning tarpit!