Marginalia Goes Open Source
memex.marginalia.nu
memex.marginalia.nu
Search is presently a neighbourhood of technology that's fallen into a downtrodden ghetto. Maybe you've sowed some seeds that can grow between the cracks. But I think there are gangs and pushers roaming the streets that would be happy for it remain derelict.
Thinking about the dynamics of open source, with respect to the many different interpretations of search that create tension within such a project: It occurs to me that whenever a somewhat mature project enters the ecosystem a robust strategy is to immediately clone-fork multiple identical copies of a project. This is like a "backup strategy". From there, form several loosely coordinated project groups that can spread risk, share threat intelligence, but each work with different models of crawling, filtering, funding, presentation and so on. Keep the original as an upstream parent. One of the children may survive.
Thank you for permanently improving the FOSS search state of the art.
I have a bit of (rented) space available. Most of it on Uberspace.
What are the expected traffic requirements?
Contact me if you like. Will update info in profile immediately.
https://news.ycombinator.com/item?id=28550764 (September 2021, 725 comments)
This the first time I've seen this view of GitHub, and I'm struggling to figure out what specifically he's referring to.
I find a lot of projects because I follow people on github that star or fork really neat projects. I download projects from bitbucket, gitlab, and other self-hosted instances.
I don't know that I've ever contributed a PR back as it's just a more friction-prone process. However, I've opened hundreds of PR's and Issues on github because it's already a part of my daily process.
Thanks again
If I want to, I can signup for yet another site and do git-things with this codebase, but I have to change my daily process to include a one-off change to a new location. There are real costs with this mental flow change.
But thanks for the explanation; I don't feel it myself but it's good to know!
And let's put it this way: the moderation tools at GitHub are a bad joke. Can't even disallow abusive language, so they're 100% ineffective.
Not everything needs to be turned into an embedded discussion forum.
I also object to how the platform encourages low-effort drive-by participation from bots and the like.
You mean "image board user", right?
So yes, they deserved the abuse.
Secondly, the Sneedacity incident was abuse targeted at a fork of the Audacity project, not at the original 'hostile takeover' project itself. The fork was intended to remove said abuse you feel is deserving of more abuse.
It doesn't bother me personally, but perhaps I've already been indoctrinated over the past ten years.
Reactions are not really about fostering “social” aspects of code review and issue triage as much as they are to prevent the need for a build up of low effort “+1” style comments. I view them as a community management tool that OSS maintainers would be much worse off without.
Because it is easier to set up?
The intermediate goal is to have some standardized testing dataset of a couple of hundred megabytes to a gigabyte or so.
I think you should post a ToDo list on the git repo. People can then contribute their skills.
I'm in search of kindred spirits seeking to flush out the full power of the memex. I found the notes it quite interesting[1]
I've gone through quite a bit of the related content, up to watching a bit about the Gemini protocol, which is interesting.
1 - https://memex.marginalia.nu/log/08-whatever-happened-to-the-...
He might know some folks.
If it's something that compresses really well (eg text data in a database), then live compression filesystems (eg ZFS, likely others) could potentially help make that workable.
I am ready to start paying money for search engine. So fed up with google SEO spam.
It's got an internet search engine, a lo-fi wikipedia mirror, this thing <https://search.marginalia.nu/explore/random>, and more.
My gitea instance is on a poor Raspberry Pi, probably won't survive HN front page :P
What is your plan for sustaining the project in terms of contributions, funding and hardware?
> What is your plan for sustaining the project in terms of contributions, funding and hardware?
Still much to figure out. The project is still fairly immature in general.
As far as hardware and funding goes, it's sort of sustainable now through not demanding very much in either, but more of both would no doubt be necessary to grow much farther. It's a bit claustrophobic not really having a proper CI machine or test instance for example.
Don't forget to press caps lock as you begin typing to save your pinky fingers, I wouldn't want to be responsible for nasty RSI.
i like your attitude. i think you are off to a good start.
that data file, could you host that on github (or gitlab maybe)?
listen, friend, be careful. you don't know what you are dealing with here. put down your device and back away slowly. this stuff is very potent. it's dangerous. if you keep reading, your productivity will go to zero. you may loose your job and your friends. your family may disown you.
if you continue, you are on your own. don't say i didn't warn you!
Thanks for the open sourcing
about the search engine: https://memex.marginalia.nu/projects/edge/about.gmi
about the encyclopedia: https://encyclopedia.marginalia.nu/wiki-clean.html