Hacker News Reader

Comment by ocihangir | Hacker News Reader

Tested your example, the confidence is 0. In smart home context, I can think of an application where the low confidence answers can be forwarded to cloud, whereas the vast majority generic queries solved locally, if the confidence is reliable enough. The response is quite fast by the way.

View on HN

But this isn’t a query that should need to be forwarded to the cloud for acting on!

I don't know, the back of my napkin says you'll need consensus of at least three servers in order to complete the command.

It is a 14MB model. You don’t need servers to run it. Check your napkin well.

I am sorely dissappointed that the state of the internet has become such that my sarcasm was not only possibly but actually missed.

Mine too! I was not serious. I was just answering your napkin joke. But when I reread now, it is not that obvious. I guess with text you can pass only so much of emotions.

Ah no harm, then. I considered /s, but I really thought it should be plain that I'm not crazy enough to believe one would need any more than a single local device to process such a relatively low complexity command.

Considering this is a 14MB model running almost in a microcontroller, I am fine with such ‘ambigiuous’ queries cannot be handled, as long as the model confidence score is accurate. By the way, I did not test this model thoroughly. I am speculating on the potential of a small model like this. I don’t know if this one is good enough or not.

Reply on news.ycombinator.com