Please, expose your RSS
rknight.me
rknight.me
You might find RSS feeds in other unexpected places! Use an extension to put the "subscribe via RSS" button back in your browser.
<https://addons.mozilla.org/en-US/firefox/addon/awesome-rss/> <https://chromewebstore.google.com/detail/rss-subscription-ex...>
https://www.youtube.com/feeds/videos.xml?playlist_id=PLpg6WL...
1) Google Reader and friends disappeared, and 2) Browsers stopped supporting RSS feeds natively, including discovery of a feed.
Put the functionality back in browsers where it belongs, it could at least be used to find feeds and then you can use newsbeuter or something similar to subscribe with.
Guess who makes the most widely used browser today.
I would argue that's only a part of the story. After all RSS quickly morphed into Link with a short blurb and image just like any modern link aggregation site rather than a full page of content.
The big issue was RSS was it prevents site lock-in like Facebook ect. Even Reddit pushes people to the comments to try keep you on the site as much as possible in order to have you see the link aggregator's Advertisements and more recently, to provide more robust data collection for later sale.
It also has the benefit of the site owners now being able to see somebody is subscribed to the feed. I'm visiting their website and they might see my traffic in their visitor statistics. To make this even more clear to the site owner, I add an URL parameter called /?rss_ref=heyhomepage.com
There’s no point in serving only excerpts. By serving full content the people like you who like to consume on the original site can still do that.
Serving blurbs forces everyone to do that and that’s wrong imo.
What I also do is filter out all the markup and even links, I only show some sentences of text basically. It sits wrong with me to make my reader a sort of browser window and display all the markup.
Beautifully simple site you have, by the way. And I found I'm already subscribed to your feed.
"RSS is not a notification system. It's a distribution system." you say on your site. Was that the purpose of the inventors? I guess I take the freedom to use it slightly different then, we're on Hacker News after all. ;) We can agree to disagree.
This is why I took over the maintaince of the Feediron plugin for the TT-RSS feedreader, I really like having the flexibility to define what content I feel is relevant on a feed by feed basis
But I can see why not all situations allow for sending full content via rss.
I still believe that IF you can send the full content you should do so.
Shit gets removed, people get upset, and they're told to deal with it. They didn't consider that the people who used the features that were removed also didn't send telemetry data, so they made a dumb decision based on incomplete and inaccurate data instead of something sane like appeal to the community and invite people to maintain or test it.
To discover a feed, just check the html source. The problem is when the feed exists but it is not mentioned at all in the website.
In the media optimized for engagement/addiction, RSS provides a step off the platform, so of course they don't use it. Even many personal blogs the article mostly talks about might want to keep the reader on the site for clicks.
It's a conflict of interest between content providers and consumers (mostly advertisement). It's not an implementation issue.
What I also do with my homegrown RSS reader (see https://www.heyhomepage.com if you're interested) is adding a parameter to the links I click, like /?rss_ref=heyhomepage.com Site owners get my traffic and they can easily see where it comes from if they happen to look at their visitor statistics.
I suggest to also put the name of your reader and the total number of subscribers into the HTTP request (as user agent), if possible.
Somewhere in this same thread I said: "Exposing the number of subscribers from large RSS readers is a nice addition, but it also slightly nudges one to centralization." After second thought, I think it's better to just show this number if possible. It's better for RSS as a whole, it shows it's still alive.
I suspect with the advent of LLM, there's finally a market for this kind of stuff. People can sell data, including articles, as data source for people's ML pipelines. It's a possible path we can detox from ads.
So yes, please start with making RSS better! It's a beacon of light in a sea of darkness.
Another use case is converting articles into audio for listening on the go.
You mean RSS will improve copyright laundering?
You can give it a go here: https://lenns.io. I'd be happy to get some feedback. Thanks.
This is the reason I gave up on trying to use RSS.
If I'm going to have to follow a link anyway, I'll just save myself the time and go directly to the websites I want to read.
The idea is that checking an Inbox-like reader dashboard with 7 feeds is less time consuming than separately going to 7 websites and scrolling around.
RSS readers keep track of which items are new. They can filter items, mark them "read" and delete them. They offer searches through the items.
Using the original site instead of its feed doesn't guarantee you don't have to follow any links.
Look at this HackerNews: you have to click on links in the front page to get to the submissions, which are in different sites. Gee, how useless; if I have to click, I might as well just go directly to those websites and skip this HackerNews thing.
This analogy breaks down when you take into context what the purpose is for both sites.
HN: I want to discover new content that likeminded people find interesting.
RSS: I want to read what this person has to say specifically.
You accidentally arrived at the root of the anti-RSS rationale for many HN readers.
They don't want to actually go on the web. They want to participate in the comments section, where it's safe and sanitized; no paywalls, no 'sign up for my email list' popups, no analytics scripts, no strange site layouts.
They feel RSS should deliver exactly what they want: full-text article and images, nothing more.
Maybe RSS could be extended to FRSS (Forum RSS). Forums export posts in FRSS format, which includes elements that tell the reader how to submit replies, as well as up/down votes. The RSS reader would render its own UI for doing these things.
Or are all your followed website producing new content such that there's always something new when you check it out?
Might get around to it this Christmas, but I'm throwing it out there in case I can lazyweb it into existence.
[^1]: ht to Darek Kay's blog post, https://darekkay.com/blog/rss-subscriber-count/, for alerting me to this fact!
I try to let site owners know I'm subscribed to their feed by adding an URL parameter like /?rss_ref=heyhomepage.com They might or might not see this RSS referrer in their own visitor statistics. I also do not consume all the article's content solely in my reader, but I show a short summary and then click the link to the article. This way I can enjoy their (personal) site and they can see my traffic more clearly.
'feed', 'feed/', 'rss', 'atom', 'feed.xml',
'/feed', '/feed/', '/rss', '/atom', '/feed.xml',
'index.atom', 'index.rss', 'index.xml', 'atom.xml', 'rss.xml',
'/index.atom', '/index.rss', '/index.xml', '/atom.xml', '/rss.xml',
'.rss', '/.rss', '?rss=1', '?feed=rss2',It was certainly interesting to do and I love that the technology exists, however a lot of people handle integrating it differently. Sometimes the feed type is misreported, other times you can't quite get all of the meta data about the feed or items you'd like, whereas sometimes you either have the whole thing just throw a network error, or just have someone with control sequences in the text which breaks your attempts at parsing XML.
I'm convinced that the larger the scale of your dataset, the more potential issues you're going to run into, at some point if any type of error can occur, you're going to have to deal with it.
https://github.com/gavinanderegg/gavinanderegg.github.io/com...
I had assumed that an "application/rss+xml" link would be sufficient, but I get that folks would likely not assume that exists on all sites these days. As someone who reads blog posts mostly through RSS, I'm very happy to make this more explicit!
[1] https://mastodon.social/@gavinanderegg/111362850402497489
That's two of us now that have exposed our RSS.
Would be great if it was exposed. I presume it’s not because it’s baked into frameworks and comes along for free, but maybe that’s naive.
I see it as a filter. All the stupid clickbait content goes somewhere else, and all the quality content - where the individuals who made it have skin in the game - sits nicely in my feed reader. It's a blessing in disguise, if you ask me.
Yes, you have to put extra energy in curating a nice collection of feeds. But isn't that valid for everything good in life? This energy compounds and pays back in no-time.
Long live RSS, long live the open web!
Say I have two feeds from two different sites. The newsreader shows only the most recent (10 or 20 or whatever) articles for one feed whereas it shows all the articles from the time I subscribed to that feed for the second one. I know that the feed XML itself contains only a limited number of articles in both the cases whenever the reader requests for a refresh.
How can I make sure that the newsreader preserves (does not purge) the older articles in the first case above (I use NetNewsWire on macOS and Mozilla Thunderbird on Windows)?
It's all very implementaton dependant.
I mainly use FeedBro as a browser extension - everything is a per feed value that can be set to over ride FeedBro defaults ; in FeedBro I can bundle all different news sites (BBC, ABC(AU), Fox, CNN, etc) rss feeds under a "News" heading but cannot set a single Max Entries value that is applied to all the sub feeds - other implementations (different readers) can.
RSS is also commonly used to serve podcasts, and I've been told by a number of podcast hists that they like this because it prevents someone from sticking the RSS in their podcatcher and blasting the server with requests for every episode all at once.
I'm guessing that a lot of RSS generators have this as a default, and many of the people with their RSS set up like this simply never change the default.
- People do not feel the need to expose it as more and more RSS clients are killed, it is not often used feature
- I think that RSS client are not killed because it is a faulty standard. It is a problem with deliverability. There is no state of the art RSS client. Most of RSS clients are not feature-rich, even thunderbird. People also do not know how to manage RSS feeds, how to obtain them
- I think that people use social media, link aggregators to see 'what's new', not RSS feeds
- People that self host do not focus on details, often even not properly configure their pages. OG:fields are not set, page title is not explanatory, weird redirects are used with invalid HTTP statuses, javascript page loading. If it is a problem with these basics, then other things are treated even worse, RSS included
- RSS feeds are often even not named properly. Naming "Blog", or "Title", or "Home" your RSS feed, or page is erroneous, in the same manner that you would not entitle a Book you wrote "My Book"
RSS readers I am aware of:
- thunderbird
- https://github.com/rumca-js/Django-link-archive - RSS reader, web scraper, which I wrote
I made an extension back in the day that parses the <link> tags and puts back the feed icon where it's supposed to be (on the right side of the URL bar), and also renders the feeds properly rather than just spitting out the raw XML : https://addons.mozilla.org/en-US/firefox/addon/rss-viewer/
This is how the web used to work 10 years ago. The <link> tag has a purpose: it instructs browsers that the current page has a feed, so the browser can parse it and show a feed button to the user. Both Firefox and Chrome used to work this way 10 years ago.
Then motherfucking evil Google began its war against feeds. First it killed Google Reader, then it stopped complying with the <link> conventions, removed the feed icon from their browser and stopped rendering RSS/Atom. Firefox quickly complied too.
Let's make it clear once and for all: yes, I, can add an RSS URL to my website to make discoverability easier, but it's not my job as a web developer to explicitly make feed discoverability easier by modifying my frontend. That's just a workaround. My job as a web developer should be to provide the right <link> element, and then the browser should know what to do with it. Just like the browser is supposed to know what to do with scrollbars if my divs exceed the window size.
And, as a user, I shouldn't write my custom JavaScript to parse the feed URL from the DOM. Just like I'm not expected to write my JS user script to render the title of the page. If browsers refuse to provide such basic features, then it's a browser problem. I would say "choose a browser that natively supports feeds", but there's none left. So use extensions to mitigate the impact of feed-hostile browser politics.
Sadly doesn't work with the https://news.ycombinator.com/rss feed as it forces the download IIUC.
> This is an excellent idea and I have done so here.
I don't know if this was sarcasm or whether it's just a bit silly that literally the next line of text on the page is a link (the link?) to subscribe—with the RSS icon—in white on magenta.
however since past at least 5 years, many tech sites have implemented "dark patterns" to hinder the experience and to nudge you to open their website. the "click here to read more" or just giving the summary outright does not help with the goal of having a feed.
i get that in today's age, where everyone wants to gatekeep their "content", it is an easy way to scrape data (i truly hope this does not become a trend). at the same time, it is so cheap to maintain that even static site running on solar can manage it (https://solar.lowtechmagazine.com/feeds)
I just dump all of our blog content in there (250 posts) and it's a lot of content haha. I don't know how you're supposed to set it up and there are so few guides on it
It was fairly popular on HN when it first went live: https://news.ycombinator.com/item?id=31293488
It has a section on discovery: https://kevincox.ca/2022/05/06/rss-feed-best-practices/#disc...
Assuming you kept the @ list of accounts through some other means, if you had your webfinger setup with your public key, you could after creating new content to push up sign the publish events and push them to those followers.
I don't know of anyone doing this though.
I also read another blog about it a while back, but essentially you have the same issue as comment systems where it can't be static, there needs to be some server component handling the back and forth.
Checkout my RSS feed of AI characters and Chatbots getting created netwrck.com/rss.xml
I have a blog and try my best to maintain the RSS feed. But if we’re being honest it’s a waste of time.
I stopped using RSS readers when half my subs required me to open a browser tab to go to the actual website to view the actual content. Webcomics were particularly annoying about this.
I mean I get it. The ideal RSS feed has no ads which means no revenue for people working hard to create interesting things I want to read! Alas.
In addition to a few blogs, I use rss for news pages (including hacker news front page) and to get notified about new package releases in pypi and rubygems. For the package releases, I just mark them as read as soon as I upgrade my virtualenvs.
Social aggregators are great for discovery, they can let the community surface good items, but they suck for subscription. Once I have found authors that I like I want a way to reliably see their content, not hoping that it happens to be popular on the site at around the time that I happen to visit. Unless you are refreshing your feed hourly you are going to miss a lot of content from your favourite authors, and even the most addicted users won't see it all. As an author I also appreciate loyalty of subscribers more than viral surges, but I understand that the money is probably better with the viral surges.
It's also a category error to compare RSS and social aggregators.
The biggest issue I have with RSS is that by the time I find interesting blogs, they’ve stopped posting, so I never see updates in their feeds. But that’s an issue with blogs, not RSS.
The RSS client that I use, InoReader, has an option to fetch full content if it is just a blurb. So, I have to never deal such annoyances.
I don't see a problem with this at all, the best things on the internet are free and open source.
Everyone gets content for free and the author gets more views everybody wins.
Bummer!
Isn't that like the ideal anything-else? What's specific about RSS on ads?
Reddit supports RSS.