Google Groups ending support for Usenet
support.google.com
support.google.com
Usenet gets better as it gets smaller, honestly. Most groups are carcasses these days, but several have regular use. comp.misc, misc.news.internet.discuss, and sci.misc are active. Several groups in the comp* hierarchy are active. Thunderbird, claws-mail, sylpheed, tin, slrn, alpine, neomutt all handle Usenet just fine. Visit http://newsgroupreviews.com for a list of providers, some free, some paid.
https://en.wikipedia.org/wiki/Usenet
https://en.wikipedia.org/wiki/Nntp
As for "why pay separate provider" -- that would be because circa 2000 most ISP's dropped offering Usenet access for their customers as part of the deal, which created a market for the paid providers.
But, you don't /have/ to pay:
Unfortunately, when DejaNews came out it became clear that at least one person out there recorded everything. Many an embarrassing post of mine was unearthed. When one has tens of thousands of posts and is young & stupid, that was bound to happen. Of course now all these years later I can barely find any of my posts on the internet, embarrassing or otherwise.
It should be possible to have other things built on top of the protocol. The protocol is a store-and-forward broadcast system, and is mostly agnostic to what goes in the packets, although if you want to add a group, each server operator has to agree to carry it, and they can have server-specific restrictions on things like message sizes, dropping messages outside the limits, so it isn't reliable. If you wanted to make a Usenet group simulating Reddit, you could easily pass votes through the system. Clients would have to interpret them, so you'd have to write your own client.
It's tolerant of spam as long as it isn't extremely excessive. There was talk of de-peering Google due to a large volume of spam, before Google made the decision itself, but most groups are about half spam besides that. The low volume of actual users contributes to this.
There's a group, I think news.admin.peering, for requesting your own server to be connected to the network. I see many successful requests from various people in the group's history. The network is fully decentralized, so being connected is reliant on at least one other person being willing to connect to you.
In much the same way that you need a specialized email client to use IMAP/SMTP, you need a specialized client that speaks NNTP to access usenet.
The providers are heterogeneous but usually are basically beefy servers connected to fat pipes to handle the massive volume of traffic, which is why you typically need to pay for access.
You post a message to your (NNTP) server. Your server connects to other peer NNTP servers to transfer messages back and forth, so eventually your message will propagate throughout the usenet network. (40 years ago peering was through UUCP, etc, and done at night when phone calls were cheaper or only to other local numbers so it might take a week, now it doesn't take that long. See also, bang paths).
Clearly they ignored me as they should.
It's same with usenet... you can get the "chat"/discusson part everywhere now (reddit,...), usually with a bit better UI and it doesn't really offer much more than that. Back in the time, it was the best (and well.. the only) thing to have.. now with alternatives, people move elsewhere, and unless you find a niche you're interested in and a community exists on usenet, you won't have much to do there.
There's no organic discussion happening on reddit. Even the TV show subreddits are tightly moderated these days. If you try and 'discuss' in a way that invites genuine criticism and isn't just mindless cheerleading of the product on offer you'll find yourself railroaded off the site in short order, and the political/real-world/location subs are an order of magnitude more controlled.
Replies don’t get lost because the discussion has moved on or the thread is a day old, like they do on HN and Reddit. This enables long-running, structured discussions. There are more usability aspects related to the text editor used, such as editor commands for handling quotes when replying. There are of course the usual(?) forum features of being able to ignore (filter out) specific users, and other features like automatically highlighting/ranking/filtering messages based on other criteria. But the main usability benefits come from per-message read/unread tracking, keyboard navigation, and the compact thread representation.
Note how on HN and Reddit you have threading, but because each message is displayed inline, you see less of a thread at once. You also see only one topic (thread) at once, whereas in a Usenet client you see all recent or currently ongoing threads in the same view as the intra-thread structure. This causes a more shared experience of subscribers of a newsgroup being aware of the current ongoing threads (over days and weeks) than on Reddit and HN. And most importantly, when returning to a discussion thread, on Reddit and HN you don’t see which messages you have already read and which you haven’t, and thus threads die out after a short time, and longer-form discussions are not practical. The experience is profoundly different.
In the old days, the issues were that bandwidth and disk were expensive. That's no longer true.
Is there a techncial reason we can't have individuals running NNTP nodes?
That's what ARPANET and the early Internet were, where "small" meant < 1 million active participants and "controlled access" meant meeting the requirement of belonging to one of a limited number of academic institutions, tech companies, government agencies, or select military units. Total Usenet participation in April 1988 were 140,000 readers, by Eric Reid's DEC surveys, as cited in John S. Quarterman's The Matrix (1990):
<https://archive.org/details/matrixcomputerne0000quar/page/24...>
Spinning up an NNTP group for internal company communications, for a family group, or for a (sufficently tech-savvy) organisation or hobby group would be a viable option. My experience is that peak group experience tends to occur with somewhere between about 5 and maybe 1,000 participants on the high end, and that's being generous. In practice, 5--50 is probably a better sweet spot.
The technology isn't the stumbling point nearly so much as convincing people to use the service. In some industries, privacy and disclosure rules may preempt usage (e.g., healthcare, finance). And the fact that Usenet has no intrinsic authentication or attestation of identity (though these can be provided by additional mechanisms such as PGP/GPG signatures) means that publicly accessible newsgroups are likely to be nonviable given malicious actors.
What's underappreciated about much of the early Internet / online world is how small most of the "large" (as in influential) groups or movements were. Usenet, the WELL, Slashdot, and early blogging had core groups of perhaps a few hundred to a few thousand people, possibly fewer. Yes, there were additional participants in many cases, but in terms of how concentrated the bulk of activity was, small.
Basic protocols such as NNTP and IRC have the benefit of being stable, small (running a Usenet server on an OpenWRT router with additional writeable storage would be doable, running a Fediverse instance not so much), and being relatively client-independent and even protocol-flexible. NNTP <-> SMTP gateways are, for example, A Thing, and people can participate in such newsgroups from either Usenet or email clients. Similarly Web gateways to either NNTP or SMTP systems.
The flipside is that the underlying protocols are also simple and absent some additional tooling lack much of what it is that people have come to expect from more recent messaging systems:
- Mobile device access. That's probably the big one, though I'd argue that for useful discussion you're better off eliminating mobile use. I've commented that losing a keyboard and being forced to a small screen cuts my effective IQ by half, and that quality of discussion on public systems also seems strongly negatively affected by mobile use. Read-only access might be a compromise, with some "I have something to say but will wait until I can access a Real Computer" might be an option. Android + Termux + Bluetooth keyboard meets my minimums as "real computer", FWIW.
- Formatted text, usually a flavour of Markdown or some "smart editor" for normies. Then again, we seem to survive with much less than that on HN.
- Images. That's the principle feature NNTP lacks natively, though they can be shoehorned in via uuencoded posts. Along with audio and video, the ability to create multimedia posts (popular, occasionally useful, terribly abused) might be an objection raised by many.
- Third-party clients. The great strength/weakness of NNTP and SMTP are that neither are locked to a single client, or Web client (though the latter is available). Having a specific tailored client program (tin, slrn, Emacs, pan, etc.) is useful because the features of the platform are strongly supported by those clients. Downside is Yet Another Piece of Software to install and train on. In the mobile world apps have been breaking the notion of everything-in-the-browser, though often bringing along their own set of issues, most notably surveillance, but also general issues of design, UI/UX, maintenance, security, and abandonment.
The initial question addressed could and the answer really is "trivially", from a technical level.
Yours is "should", and as I'd hinted in my initial response, that's far more social and up for debate (as we're doing here).
But at least you're demonstrating a exception to Ian Malcolm's could/should criticism.
How would your ISP know?
NNTP originally was originally store-and-forward over dialup like links, no?
So, if I contact a different server and upload/download the changed data, how would they even know?
I guess the big issue would be having some "rendezvous" server in order to help with NAT punching as well as authentication.
There were some bad ideas in the beginning, FTP as an example of several of those
...or so I've heard
It probably seemed like a good idea at the time, and there was no way to know the problems without trying it.
It also allows you to send a command to cancel an ongoing transfer.
For streaming mode STORe/RETRieve the connection closes at the EOF so you could send the request but the response would be lost.
[1]
It is possible for the user to specify an alternate data port by
use of the PORT command. The user may want a file dumped on a TAC
line printer or retrieved from a third party host.NNTP is to USENET what ActivityPub is Mastadon. USENET is a confederation of cooperating peers, currently using NNTP, but it could be any mechanic to move the messages. You could wire it up using SCP I imagine if you were motivated to do so.
Specifically, the NNTP protocol does not talk directly to how USENET works. For example, you can find out how to exchange messages for particular topics using NNTP, but not how to actually create those topics. That left to the actual software and administrators. USENET using the concept of "Control Messages" to exchange information about things like newsgroup status, but the content and format of those messages are not specified in NNTP.
As a USENET peer, pretty much all peers are "equal". You host your own news server, you tell it what groups you're interested in, it peers with another host and exchanges messages about those groups. At that level, they're equal.
But just because you create a newsgroup on your system, doesn't mean that group is instantly propagated across the planet. That's where the USENET governance kicks in as to who is going peer and distribute new groups, or not. Each individual relationship within the peer group can be different.
I can't say exactly how a news client differs from a news server. It may not have any of the peering logic, posting and reading groups directly from a server which then handles the peering. News servers "peer", clients are lighter weight.
Some discussion here https://www.reddit.com/r/usenet/comments/ziqdh2/become_my_ow...
If you want text groups, it must be a lot lower.
I think that's where the "build your own network using nntp" comes in
The textual discussion network may as well be its own wholly separate network. I only know of Eternal September, but I'm sure there are other servers.
misc.news.internet.discuss and sci.misc are bascially a single person posting links without any discussion.
> we're losing
I'm certainly not losing anything. Only people who need Google services to access Usenet are losing. And I make no apology for being elitist here - some clubs are better when they are mostly frequented by the elite.But, I'll tell you what we're not losing when Google drops support for USENET: the archives. And, IMO, that's where the real value in Google Groups[2] lies, and has for decades.
---
[1]: https://en.wikipedia.org/wiki/Eternal_September
[2]: Née DejaNews -- oh, how we miss you!
e: I misunderstood and thought the Google archives were going away in 2024.
If you want to use Usenet, just get a news reader, don't go through Google.
And hope the provider actually carries text groups and not only pirate movie groups.
I think it matters a lot to that company and, in particular, to the question of why they might not be willing to put much effort into USENET support.
Google already had a quality problems before due to culture of zero support and dropping projects after their managers' got promoted, but now they have a problem with keeping up to any standards.
That's how it works when you offshore everything - where the main criteria is price and nobody cares about quality at all. They could offshore to mid cost countries, but they offshore to cheapest bidders.
As for sending stuff offshore, they should seriously rid themselves of this products/services instead. They need to cut costs, headcount, and company complexity. They need to focus on their core product before they die: search and ads.
[1]google
(After the acqusitition, for a while Javascript was required to access comp.unix.* groups via Google Groups. Eventually, after years went by, this was fixed. But even then some of the data from these groups and other computing related groups is missing. Neither Google Groups, nor any of the well-known spools from individual archivists, contain _all_ of the data from what was available before the Google acquisition.)
I've downloaded a few newsgroups that I care about so I can search offline since Google usenet search is not very good.
It is a shame and a huge missed opportunity that archive.org doesn't have a usable usenet browser/searching. I would build it for free. Heck, I would pay them (well, I do donate).
Will be really disappointed if the archive falls into an even worse state of disrepair.
As such, I needed to find a Usenet provider who would accept posting into moderated groups, from a moderator.
I originally contacted Eternal September, and Wolfgang informed me my account had been configured to allow such posting, but it does not work ("account not authorized") and now he does not respond to email.
I then contacted four commercial providers, all of whom did not know about moderated groups, and either failed to respond in a timely manner (a week) or failed to grasp the concept of moderated groups;
1. Giganews
2. Tweaknews
3. Eweka
4. Usenetserver
Giganews first line support did not know about moderated news-groups. I explained, and once the support staffer understood, a support ticket was created. Giganews claim a few hours response time. When asked about this, they then say up to three days. After seven days, I cancelled the support ticket.
Tweakness, Eweka and Usenetserver I think are in fact the same company. I could be completely wrong, but they all use the same support software, have the same options in the drop down lists on their sites, and so on.
All did not know about moderated news-groups, and all were unable to grasp the concept, and all then went into that failure mode, where support is giving the wrong answers to questions, not paying attention to what is written, not reading the history of communication, and so finally going into a loop which consisted of them telling me "you need an account to post" (where they meant posting normally - not as a moderator), which they had said before, and which I had replied to before (explaining again about moderated news-groups, to which they explained Usenet is not moderated and anyone can post, etc, etc, etc).
After two weeks, I gave up with them.
UsenetExpress is the second-biggest provider of binary news (outside of Omicron, which owns Eweka, Newshosting, UsenetServer & Tweaknews)
> To find a client, do a web search for "how do I find a usenet text client"
Result: https://imgur.com/a/8VrfuPu
Remove the quotes.
Happens to all of us.
Bet whoever wrote that instruction never expected this.
To be fair though, even without the quotes the first 4 links are the same! The query itself is also a poor representation of a good search query for Usenet clients.
https://imgur.com/gallery/i9OU844
I've had so many people tell me that DDG is inferior to Google Search, but that has not been my experience, at all.
I use DDG for ideological reasons but in my experience Google Search has always been the better engine when searching for specific queries while for general queries most search engines are roughly the same. In terms of overall performance I'd say Google takes the cake, followed by Brave and then DDG/Bing/...
> You can continue to view and search for historical Usenet content posted before February 22, 2024 on Google Groups.
https://www.electricmonk.nl/log/2005/12/21/how-google-fucked...
https://thenextweb.com/news/google-groups-stopped-indexing-u...
https://www.vice.com/en/article/jp5a77/google-a-search-compa...
https://www.reddit.com/r/usenet/comments/3ggogo/google_has_l...
https://groups.google.com/g/comp.arch.embedded/c/zKo883p9AJQ
What about the newsgroups where access (including the archives!) had been blocked by Google for too much spam (maybe ironically facilitated by Google Groups in the first place)?
Currently, at least mozilla.support.seamonkey (not a USENET group, but from news.mozilla.org - which was shut down, but whose archived content would certainly be useful) is in that state at Google Groups. And yes, IIRC the only SPAM in recent times in that group had been posted via Google Groups...
Literally all my recruiter spam is coming from groups. Even when I worked at Google internally I raised a ticket with full info of what’s going on and they still haven’t fixed it.
(Yes I have the “can’t add me to groups” button on).
If you know anyone still there, just have a peek at all the internally opened tickets about bricked Android phones. Their processes are...messy.
I'm regularly pleasantly surprised when I file a bug for something on the other side of the company and get proper engagement on it.
I don't know why but I feel this was written by a young gun who doesn't know how usenet, irc etc works and just wants to push everyone to discord and slack.
Make an account on Ray Banana's "Eternal September" server (or any one of the others), connect a client and you're good to go.
news:alt.folklore.computers is active
I enjoy the news:comp.sys.acorn hierarchy but then I was an Archimedes user.
https://news.ycombinator.com/item?id=38238796
The usenet archive will remain.
Just a reminder that there was online Usenet discussion for the fall of Berlin wall, in real time.
Amazing
https://groups.google.com/g/alt.comp.hardware.pc-homebuilt/c...
This also means many broken links, I hope a solution will be found for this.
sundar: we are working on an amazing new ai
sundar later:
https://github.com/material-components/material-components-w...
Two examples that come to mind but there are plenty
While I understand the frustration, I see package managers and Bazel as quite distinct approaches, and I'm not surprised that they are incompatible. There shouldn't be anything incompatible between Firebase itself and Bazel – I can assure you that Bazel is used to build wildly esoteric things at Google – but the Cocoapods/SPM layer is sort of fighting an uphill battle because Bazel is built on the assumption that it's building everything itself.
I work on a very large mobile app that is built with Bazel, and can attest to how worth it the experience is at scale, but I realise it takes a lot of doing to make it work, and that doesn't pay off until a certain point.
Cocoapods and SPM has nothing to do with it. You can’t blame packaging ecosystems for Bazel’s inability to consume a dynamic iOS framework properly.
Yes, I’m aware it’s possible, as explained in that thread. The problem is that it’s only possible for people like you!
So while I appreciate the thank you, as a user, id appreciate a fix a lot more.
I get the frustration, I really do. It makes sense that different Google technologies should work with each other like in this case, but I can see why this sort of thing slips through the cracks when the teams are so far removed from each other.
Regarding Bazel's ability to do this, I can't say for sure, but I see a common pattern in Bazel usage outside of Google where users expect it to work at a higher level than it does. At a fundamental level if you can do it on the command line by running commands and moving files around, then Bazel can do it (hermetically, reproducibly, etc). Big Bazel deployments build up a lot of build definitions that handle all these things and abstract away the details, and these may be what's missing.
Anecdotally, I work on a very large Android app, and it's all built with Bazel rules that are many layers deep of customisation. At the bottom somewhere is a `java_binary` rule or something like that from Bazel itself, but there's a lot of customisation to make it work for us. It sounds like this would be necessary to get Firebase working. Ultimately though if Xcode can build it, Bazel can script it.
As for Cocoapods/SPM etc, the reason I said these were at odds with the Bazel process is because Bazel is designed for a world without package managers where you just have all the code in your monorepo with the appropriate BUILD files, because this is how Google works. It sounds like there is tooling to work around this and get the code into the Bazel cache, but it's unlikely that automatically generating BUILD files is always going to get it right.