Hacker News Reader

I just tried the android application, really like the privacy first approach. Would you consider adding BYOK so that a user could have complete control over where inference happens? I realize it might not fit your architecture, but it seems like a neat optional setting. Either way, neat project.

View on HN

I did consider it at one point the problem is that the prompt and instruction following for formating and extracting tags, nouns etc and the json returns are unreliable if you switch models and especially if it's an older model. right now i'm using Gemma 4 and works smoothly so it would need to be BYOK for gemma only which is doable. If more people ask I could do it sure.

I would not use a personal journaling app that didn't give me that type of control, so here's one more asking :)

the best would be on device inference only but we need maybe 6 months for a small model to match capabilities yet. I wanted to do it like that but even my pixel 10 suffered.

Reply on news.ycombinator.com