Hacker News Reader

Comment by lxgr | Hacker News Reader

Very interesting project.

I wish this was actually (optional) built-in behavior for browsers when bookmarking pages, or at least when adding to a "read later" list like Pocket/Instapaper etc.

Pocket seems to offer something like this, but only in the premium version, so the "permanent archive" ironically seems to go away when unsubscribing.

As a workaround, what if bookmarking a (public) page could actually ping it to archive.org for archival?

View on HN

I implemented some options for that purpose in SingleFile [1]. They allow you to save the page when you bookmark it and eventually replace the URL of the page with the file URI on your disk.

[1] https://github.com/gildas-lormeau/SingleFile

Cool, I was so into maff back in the days. I'll give it a try.

(I even wrote this before checking out your link: Have you heard of https://en.wikipedia.org/wiki/Mozilla_Archive_Format from two or three Internets ago ? If so what's your thoughts on it ?)

I would recommend you to take a look at SingleFileZ [1], it should remind you of something ;)

[1] https://github.com/gildas-lormeau/SingleFileZ

Why a zip file instead of a WARC file?

https://en.wikipedia.org/wiki/Web_ARChive

Because it's easier to produce and extract. The zip format also allows creating self-extracting files (I'm referring to SingleFileZ). I'm not sure this is possible with the WARC format.

I see you answered this in a thread a year ago [1] (came up in a Google search), my apologies.

[1] https://news.ycombinator.com/item?id=21426056

see: https://github.com/c9fe/22120#why-not-warc-or-another-format...

> Both WARC and MHTML require mutilatious modifications of the resources so that the resources can be "forced to fit" the format. At 22120, we believe this is not required

This is false. If you're doing WARC correctly, HTTP resources/responses are stored verbatim.

Perhaps the only possible purer format would be packet captures, say of the full HTTPS session, along with the session keymatter and connection metadata to later extract the verbatim HTTP resources. That'd be interesting, but I doubt that's what this "22120 format" (for which I see no documentation links) does.

selfplug: https://sbeckeriv.github.io/personal_search/

I am working on a personal project that like this. It is in early stages. I am creating a local search based on my browser history. So it doesnt crawl pages. Also the fetch is out of bounds of the browser so Authed urls are not supported out of the box.

I have a bookmarklet currently that lets met "pin" my page. my pinned pages are my new home page. Its how I keep my tabs closed.

I do not do a full archive level (but i could). Instead you get an offline view that is stripped of most things. example https://raw.githubusercontent.com/sbeckeriv/personal_search/...

Demo of the pin:

https://www.youtube.com/watch?v=5g_mXXFwQlg

a self hosted version is on the roadmap.

I wish this was actually (optional) built-in behavior for browsers when bookmarking pages, or at least when adding to a "read later" list like Pocket/Instapaper etc.

Sideshow Ask HN: Didn't Firefox mobile work like this? I could read the reader view items offline...

Anyone knows what's happening with the whole bookmarks/collections situation?

I can confirm this. Pages you bookmarked in reader view were saved offline.

I use firefox nightly on android and the feature disappeared (I think) sometime this year when they re-did the whole ui. I can't find an article or bug ticket explaining the reason why.

I have a project https://www.github.com/dhamaniasad/crestify that does the archival to archive.org and archive.today, you might find it useful

There's also https://github.com/oduwsdl/archivenow which supports a bunch of different archiving platforms.

This is a feature of iOS safari with the read later list. It‘s not been particularly reliable for me though.

iOS's implementation is definitely useful, but I was thinking more along the lines of a permanent archive persistently stored.

iOS seems to optimize for temporary offline scenarios; saved pages do not seem to be backed up or synced to iCloud.

Yeah. I also assume it deletes the pages after they are "read" but who knows, there‘s no insight into the feature.

The best bookmarking option for archival seems to be the pinboard.in archive plan.

ArchiveBox also saves every page to archive.org by default.

Pinboard.in (not affiliated, just a happy customer) offers an archiving service for saved bookmarks.

What it doesn’t offer is an integration with the browser to make it seamless to work with those bookmarks. There are various extensions for Firefox which will save to Pinboard (one of them is mine!) but to work with them - you have the option of going to the website or using the mobile site in a sidebar (I do this, with some custom css to make it more readable for me).

There’s a nice MacOS application (sorry can’t remember the name right now) which gives you a better interface, but... they’re bookmarks. I would like them to be integrated with rather browser bookmarks. And to be usable when the site is down or I’m offline. And to appear when I search... lots of possibilities there.

Reply on news.ycombinator.com