Hacker News Reader

Comment by tuananh | Hacker News Reader

this is exactly what i want: a personal assistant.

a personal assistant to monitor everything i do on my machine, ingest it and answer question when i need.

it's not there yet (still need to manually input url, etc...) though but it's very much feasible.

I'd like something that monitors my history on all browsers (mobile and desktop, and dedicated client apps like substance, Reddit, etc) and then ingests the articles (and comments, other links with some depth level maybe) and then allows me to ask questions....that would be amazing.

yes, i want that too. not sure if anyone is building sth like this?

rewind.ai

Tried rewind, it does an amazing job grabbing everything locally and the search is great. With the addition of Kin it would be an easy buy.

mykin.ai is building this with privacy in mind. Runs small models on-device, while large ones in confidential VMs in the cloud.

But it sounds kinda creepy don't you think?

You'd be the one controlling the off-switch and the physical storage devices for the data. I'd think that this fact takes most of the potential creep out. What am I not seeing here?

> You'd be the one controlling the off-switch and the physical storage devices for the data

Based on what? The CPU is a physical storage device on my PC but it still can phone home and has backdoors.

Is there any reason to think Nvidia isn't collecting my data?

If you're on linux just monitor and block any traffic to random addresses.

If you're on Windows, what makes you think they are not already?

The Intel backdoor is at the Kernel. OS has nothing to do with it.

> what makes you think they are not already

That is the point

> But it sounds kinda creepy don't you think?

is the bash history command creepy?

Is your browsers history command creepy?

Yes to both?

But those also don't try to reinterpret what I wrote.

it is all local so, no?

It generates responses locally, but does your data stay local? It's fine if you only ever use it on a device that you leave offline 100% of the time, but otherwise I'd pay close attention to what it's doing. Nvidia doesn't have a great track record when it comes to privacy (for example: https://news.ycombinator.com/item?id=12884762).

The source is available, minus the installer. You could always use the base repo after verifying it:

https://github.com/NVIDIA/trt-llm-rag-windows

if it's 100% local then fine.

Reply on news.ycombinator.com