kanishkalinux

Thanks. I've written about it in detailed in the README. But most important thing that differentiate it from other self-hosted variants is the ability to see references along with chat and ability to exclude/include specific sources from your local sources for targeted discussion. Moreover it has integrated note taking feature in markdown, so that all of your digital knowledge-base is at one place.

Inquisitive - self-hosted knowledge-base with a touch of LLM/RAG.

Link: https://github.com/kanishka-linux/inquisitive

I've been working on this on and off since last couple of months to consolidate all of my digital knowledge-base like notes/links/pdf etc with the help of LLM/RAG. It is fully self-hosted with very minimal setup instructions - which should be easily installable by anyone on their local machine.

UI is very bare minimal. It still has some rough edges when it comes to the UI part, but usable. I've been regularly using it since sometime, and it works well (atleast for my use case) when it comes to searching and organizing personal knowledge-base.

Feel free to try it!

By the way, this application is not just about archiving. For regular archiving wget (and in your case HTTrack), are more than sufficient. Reminiscence has been developed for bookmarking, archiving, organizing and access from anywhere.

Pretty detailed suggestions! Thanks. I'll keep them in mind when iterating on next version of the project.

I think, wget is even better and much older than it.

About videos, I'm thinking about providing some way to add custom user scripts, so that users can use their favorite download manager to download media elements from site.

About gif, they are will be included in the archived page. Everything with 'img' tag will be fetched for archiving.

That was amazing feedback! Thanks a lot!

About user-interface, I agree it needs improvement. Especially inbuilt reader needs some work.

Can you suggest some improvements in UI?

It looks quite innovative. I'll see if I can get some ideas from it.

Thanks! I'll add support for annotations in project's TODO list. It'll be a nice addition to any archiving solution.

Thanks! I have not used shaarli and bookmark-archiver personally. But from their documentation it looks like shaarli doesn't archive in various formats and doesn't have auto-tagging feature. About bookmark-archiver, I think one can't add links into it directly via web-interface and doesn't organize links directory-wise apart from features like auto-tagging and summarization. I'll look into alternative bookmark managers, and will try to provide some comparison chart in README.

Thanks. I didn't know about webrecorder. It also looks cool. I'll look into it.

It doesn't integrate web-server in default installation. In docker installation, one can change docker-files and remove components which they do not want.

Currently, it does not allow full spidering.

Reminiscence has some advance features like auto-tagging, auto-summarization and archiving in various formats, which separates it from other bookmark managers. Few days back, I posted it on r/selfhosted and there one fellow redditor suggested to contact Floccus dev, instead to writing bookmark addon for every browser. Hopefully, I'll get in touch with the Floccus dev and will see if it can support Reminiscence in some form or other.

Walter Rudin's book on Real Analysis is normally considered as classic in this area. However, you can also take a look at Mathematical Analysis by Tom M. Apostol, which helps in developing good intuition about the subject.

for mostly static pages requests/pycurl + beautifulsoup more than sufficient. For advance scraping, take a look at scrapy.

for javascript heavy pages most people rely on selenium webdriver. However you can also try hlspy (https://github.com/kanishka-linux/hlspy), which is a little utility I made a while ago for dealing with javascript heavy pages for simple usage.

phantomjs was also based on qt technology (qtwebkit)

It's based on qtwebengine(chromium).

Thanks

kawaii-player is an audio/video player and manager with builtin media server. Media server of this application can be turned on and off with just one click anywhere and anytime without any complicated setup. Most of the media servers are normally designed to have their own dedicated server machine which are normally switched on 24x7. But this application allows user to start and create media server instance on the fly on any working computer, so that they can share media with their own other computers and devices, without involving any third party in between. And once it's done, they can switch it off.

The application has also developed the concept of universal playlist generation with mixed content (i.e local audio, local video, youtube url, addons url or even torrent stream), which once generated by media server can be played on any device, on any platform with popular clients which allows playing http streams. It doesn't perform any transcoding, since players like mpv/mplayer/vlc can play any format. Moreover vlc and kodi are available on mobile platforms also, which are able to play media without transcoding. It also features a dry and boring web interface for accessing your collection and generating universal playlist.

The application originally started as simple combined audio/video player/manager with support for custom addons. But I thought that, once our media collection is organised, there are instances when we want to access it from other devices. There are many solutions to it in the market, but I wanted a lightweight, portable and no-heavy setup kind of solution; hence I built media server within the player itself.

User can fire up media server anywhere, and can share content with other devices using wi-fi. If wi-fi is not available in particular area, then user can create their own wi-fi network, by converting any android device or computer as wi-fi hotspot.

Apart from above mentioned unique features, the application has many more features such as torrent streaming, detached video mode, youtube wrapper using qtwebengine etc.. which are not normally found in other media player applications, which users can explore by following README of the project page.

PS: When I started writing the application, I knew nothing about python and ecosystem surrounding it. I just wanted to create a simple gui based native application quickly for my personal use only. I had no intention of writing some 30k lines of code with so many features. But once I started, I could not resist adding more and more features, since I was really having fun with python!!. Due to some bad design choices and my lack of knowledge about python and it's ecosystem in the beginning, the code has become unmageable and messy, which will make it difficult to add new features unless I refactor the code properly. But the programme is currently working as expected on my system. And theoretically the application can be installed on any system which supports installation of python-3.5+ and pyqt5-5.5+.