Hacker News Reader

Comment by catmanjan | Hacker News Reader

Because customers aren't satisfied with pretty decent when it comes to speech to text, if it isn't state of the art there's someone just around the corner doing it better....

View on HN

I mean, is the processing power of today's voice software actually impossible to do without a cloud service subscription, or is it that the developers working on the problem today would rather not work on it for local operation because they can't charge cloud pricing or collect user data that way?

Most local voice processing solutions seemed to stop dead in their tracks, developmentally, when companies figured out we could make this a cloud service, but I don't know if I really believe it's technically unfeasible the other way.

Speech-to-text still works when my Pixel 2 is in airplane mode, so there must be some local fallback. It's good, but not as good as the cloud-backed version.

the Android standalone model is a surprising 20MB small. presumably a one gigabyte model would get you back closer to state-of-the-art.

There is at least one startup working on a local solution (I forget their name), but my understanding is that it's still technically inferior - for example it can only support very small vocabularies.

The bottleneck is simply raw gpu compute power available.

I completely agree with you that the technical gap might be caused in part by incentives from cloud companies. Why invest in researching something that makes your core business less valuable?

Amazon and Google both most likely have more to gain from reducing their compute requirements for in house voice recognition than from keeping the cost high for others.

Reply on news.ycombinator.com