Khoj provides exactly that; it runs on your machine, none of your data leaves your machine and it has a web interface to chat