The Wall Street Journal to Close Google Loophole Entirely
digiday.com
digiday.com
E.g. https://www.facebook.com/l.php?u=https://www.wsj.com/article...
Do we know that this will still work on Monday? Maybe this will also be closed and you'll need a special link?
javascript:window.location="https://m.facebook.com/l.php?u="+encodeURIComponent(window.location.href);
Bookmarklet for Google: javascript:window.location="https://www.google.com/url?rct=j&url="+encodeURIComponent(window.location.href);Create a bookmark of any page, by going to a URL such as https://www.wsj.com/articles/SB122878081364889613 (note that only the top part of the page loads) and enter Cmd (or Ctrl) D. Now Save the bookmark to your bookmark bar. Find the bookmark, right click, and replace the WSJ URL with the javascript URL in the parent post. Save and now test by clicking the bookmark in the bookmark bar. After a redirect through Facebook, the full WSJ article should display.
Another useful bookmarklet for deleting annoying DOM elements:
javascript:(function(){document.styleSheets[0].addRule(".highlighted_to_remove","background:red !important");var e=function(e){if(e.keyCode==27){i()}};document.addEventListener("keydown",e);var t=function(e){e.stopPropagation();this.classList.add("highlighted_to_remove");return false};var n=function(e){e.stopPropagation();this.classList.remove("highlighted_to_remove");return false};var r=function(e){this.parentNode.removeChild(this);i();e.preventDefault();e.stopPropagation();return false};var i=function(){var i=0;var s=document;while(s=document.body.getElementsByTagName("*").item(i++)){s.removeEventListener("mouseover",t);s.removeEventListener("mouseout",n);s.removeEventListener("click",r);s.classList.remove("highlighted_to_remove")}document.removeEventListener("keydown",e)};var s=0;var o=document;while(o=document.body.getElementsByTagName("*").item(s++)){o.addEventListener("mouseover",t);o.addEventListener("mouseout",n);o.addEventListener("click",r)}})()What if my browser could just say "article will be 25 cents?" and I could say y/n? But instead, I have to sign up for a service, hand over my credit card, blah blah, and now you've wasted enough of my time that it was worth just me stealing it.
I'm pretty convinced it's just aUX thing.
This is even true if you only subscribe to relatively reputable traditional news sources, btw. Here are 12 that individually are worth it and most informed individuals would be served by reading on occasion, but few people would want to have individual subscriptions to them: WSJ, NYT, WaPo, The Economist, The Atlantic, Foreign Policy, Chicago Tribune, SF Chronicle, The Guardian, Le Monde, El País, Die Welt. Nevermind the fact that I do have subscriptions to 2 of those, and they compound the problem by serving annoying video ads even to subscribers.
Edit: A model that I would consider fair though (and the journals might not, I don't know their cost structure) is: 2-5 free articles a month without subscription of any sort and with unobtrusive ads, paid subscription if you read more articles a month from that particular journal. Another option is a "library" subscription model, in which you pay $20 or $30 a month, but get access to a broad catalog of newspapers (about what you would find at a large public library in print) and they get profits based on what you actually read. And yes, I have seen this as a startup idea, Netflix for news, but newspapers never seem to go for it wholeheartedly enough for it to be worthwhile to consumers, though.
I have much less brand loyalty now than say 10 years ago. I have less respect for both the WSJ and NYT than I did. I don't think their incentives line up with mine anymore, and it leaves me without a news source I trust the way I once trusted both of them.
A larger entity that doesn't need to worry as much about getting me to hit the clickbait would serve me better as a reader (and I'd then be more likely to subscribe). Or, if I could subscribe to individual reporters or small groups of them in some way (such as Dave Pell's style of content delivery, but more availability and let me pay them some how), it would also better serve me as a reader.
Instead we're stuck with a structure where they don't make enough money, and thus continue devaluing their brands, and we as readers don't have an easy way to know who we can trust to respect us as customers (no surprise video ads, unbiased reporting, etc). So I guess I'll stick with using sites like HN to aggregate the news for me, and stop clicking on the WSJ links. The brand no longer signals unbiased quality journalism to me.
Now a days what we have is: individual journalists/teams that investigate and produce analysis, aggregators like HN or Reddit who point our which content is interesting/relevant and traditional media outlets which mostly serve to vouchsafe to some degree that the content is factual and credible. We can't get rid of the last component because we end up with no way of distinguishing real news from propaganda, disinformation and innuendo, and also because we haven't found a way to directly pay the first group except through the media orgs. A fully centralized system that certified news "accuracy" is the stuff of Orwellian fiction, though, so that's a non-starter. You could have a federated certification system, I suppose, where articles are published by individual journalists and then groups and institutions vouchsafe for the veracity of stories or the record of the journalist (sort of like TLS CAs or a web of trust of journalist peer review), but you still need to come up with a good way to pay all of the parties involved. That said, in principle, I'd rather pay for each individual article, or a monthly fee for access to nearly-all the articles available, than for a subscription to a very specific collection of articles in the way you do now with news subscriptions.
Its much easier for me to pay $10 a month
WSJ is $32.99 (+tax) a month, for digital access. That's a little harder to justify if you only occasionally read their content.1. Nobody used it
2. It didn't block ALL ads, just most (based on if you won or lost the bid)
3. There was a LOT of backlash against it because it was google and even though you can opt out of tracking nobody believes them.
4. The old "adblock is free" argument.
It used to be that you'd pay an amount between $1 and $15 per month and it would use that money to "bid" on ad spots like a normal advertiser would. If you won the bid, you'd see a picture, a pattern, or anything else you wanted in that spot. If you lost, you'd see another ad.
The fee split worked identically to a regular ad, so Google would take their cut, the site would take the rest. And any money not spent at the end of the month was refunded back to you (not rolled over, actually put back in your bank account).
But I'm arguing that publishers could simply sell per-article access. As an alternative to subscriptions. I used the current ad-brokerage system as an example, because it's so hugely cumbersome. But I'm not arguing that users should simply bid against advertisers.
- it was poorly advertised (irony!); I only found out about it from a Google engineer that said, "This is probably the kind of thing you'd pay for"
- US only
You can even get your money back when reading accidentally (guess that doesn't work 10 times in a row, but it's a good feature).
I wish there were a way to buy access to individual articles .
If you think a product is valuable, but you don't want to pay for it because you don't like the person selling it that makes you a retributive thief. You don't even have ideology to hide behind, you just don't like someone.
http://www.copyhype.com/2013/09/why-copyright-infringement-i...
Perhaps it is? I've almost never had anyone remark that I was doing something bad when not paying for a software or movie or music.
a lot of artists would PAY to get millions of downloads/views
it's a "logical fallacy" to assume they wouldn't
...which is exactly what the WSJ has been doing.
Because the publisher explicitly allows it.
Etc, etc. But again, I know there are holes in my reasoning.
That'd have to be an incredibly large one-time payment. And how would we know how much to pay?
It doesn't seem like an unsolvable problem. The drug companies themselves must have budgets, and the publicly traded ones have a stock price. So someone somewhere must be able to create estimates for this.
By definition sharing means giving it away for free.
It's really simple, if you want to put your content behind a paywall, then put it behind a paywall. Don't leave a backdoor open and then complain when people use that door.
Unfortunately, this kind of micropayment will not work for most people and perhaps more importantly will lead to less revenue for the publisher.
Clary Shirky has written about why micropayments [0] is the wrong model for consuming content more than a decade ago.
The l.php script basically allows someone to read the magazine without paying for it. The only entity that loses something in that situation is the content provider.
What do they lose?
There is a reason I subscribe to Netflix but not Hulu.
I had only discovered it when I wanted to resubscribe for other reasons; I probably would have done it earlier if I had known the option was available.
SPIEGEL: $ 9.40
FAZ: $ 44.90
WSJ: $ 30.85
Guardian: $ 6.99
KN: $ 19.99
-----------------
Total $112.13
just to read a handful of articles per newspaper?I’m sorry, I’m a student, I don’t even have Netflix because that’s too expensive.
But of course that becomes a bit of a blurry moral line. If I start browsing Google News in the hopes of stumbling upon a WSJ article so I can read it for free, is that immoral? What about if I google the headline of an article I'm interested in? Automatically setting my referer to facebook.com whenever I visit wsj.com probably goes too far, but then where do you draw the line?
Anyway, I feel very strongly that either everyone from HN should be able to freely read an article shared here, or no one. If no one can read it, then the link shouldn't be allowed here.
Then we'll have the laments: oh the ads, the humanity; or, why does all journalism suck?
We're free to send them any Referer headers we wish... in a request. It's up to them to reply however they wish.
Let's be real, they get data about you in a million ways. It'll all be aggregated somehow, and I wouldn't be surprised if they did aggregate in other ways like IP/browser, and those sharing links definitely leave cookies behind.
Also, I think Facebook (and Twitter, and others) already have a Share button on all WSJ articles that would inform them when you visit that page.
The difference between absolutely free like most content on the internet and the WSJ standard monthly rate of $33/month is truly enormous. The NYT, which I also feel is priced too high, is $15/month.
Remember Netflix costs $10/month-- that's the value proposition they need to compete against.
These content producers should charge $5/month, with no scummy "special introductory offers" where you just _know_ they're going to raise the price and screw you in a couple months. At that price I would subscribe to everything I read.
If I click on a google search link, I expect to see the same content google does.. for that matter, it's part of google's own rules... WSJ should not get a pass, and google should now deindex WSJ based on those rules.
Not because I want to support journalism (though I do), but because having a whole newspaper to flip through every day is so much more productive and efficient than getting dribs and drabs through Twitter and free news sites --- many of which are ultimately sourcing through the journalism that organizations like WaPo do anyways.
Realizing in retrospect how trifling the amount of money we're talking about for a subscription is (it's a tiny fraction of my monthly information services bill [cable/Internet, Netflix, &c]), I feel kind of embarrassed for not having done this a long time ago.
I like WaPo but you might prefer something else, like NYT or WSJ. I'm sure all the major papers are solid choices. Most of you are younger than me. Don't be like me! Subscribe to a damn newspaper already.
http://help.washingtonpost.com/link/portal/15067/15080/Artic...
I've been a long-term WSJ subscriber and recently switched to the digital-only subscription due to the quality of their tablet app, but it remains a guilty pleasure of mine to buy up a selection of hard copy newspapers on a rainy weekend and lock myself away for hours.
I hope that high quality news organizations do have a future, but the WaPo? I'm not sure that label fits.
https://www.washingtonpost.com/news/fact-checker/wp/2017/01/...
https://www.washingtonpost.com/posteverything/wp/2017/01/23/...
You'll note that the two stories are directly contradictory. The claim made by the WaPo is stronger than Senator Sanders' and yet Senator Sanders received 4 Pinocchios for the claim.
I also like FAIR's analysis of the WaPo's opinion leanings (though it leaks over to supposed factual reporting too): http://fair.org/home/washington-post-ran-16-negative-stories...
In this case I think the WaPo fact-checker was unfair in handing out Pinocchios. Four Pinocchios should be reserved for bald-faced, baseless falsities. In this case, Bernie had a source, based directly off of research. The "fact checker" criticized the details, application, and methodology of these conclusions, and offered its own, completely speculative conclusion that the real number is lower. I'm not saying this didn't deserve a Pinocchio or two, but I do think it's a bad call. That doesn't make it worthless, but I do think it certainly undermines its credibility a bit.
https://sputniknews.com/us/201612081048298376-washington-pos...
It's lies like that that legitimize Trump in the eyes of his followers.
(WaPo vs. NYT was basically a coinflip decision for me, but doing WaPo and then NYT would probably create a pretty significant overlap, and WSJ wouldn't. On the other hand, the NYT is a substantially better site than WSJ).
One axis of quality measures here, using the Foreign Policy Top 100 Global Thinkers list:
https://www.reddit.com/r/dredmorbius/comments/3hp41w/trackin...
NYT and WaPo's political slant is almost becoming unreadable for someone who's moderate and disinterested in either US party. I can't speak for WaPo but I've been reading NYT for a decade now and their total abandonment of any attempt at political neutrality was disheartening this past year.
My only problem with WSJ is it's very expensive compared to NYT. About 3-4x as expensive as a Canadian. So I've been using WaPo recently, they're slightly better than NYT but only slightly. Probably going to go full WSJ soon.
I prefer the NYT and think the reporting is better and broader - especially with regard to the fluffier sections like Sunday Styles, the Magazine, the Book Review and so on ... if I had to pick a single news source I think the A section of NYT would be my choice.
However, I have to say that I enjoy reading the Financial Times more because of their practice of condensing a story into a single page without a fold and without a jump to another page. They explore the story in more depth deeper in the paper, but you can read the front page headline column from start to finish without unfolding and page turning.
Also, the NYT has this habit of vastly over-backgrounding quotes ... a ten word quote will have 2-3 inches of comma-delimited background and qualifications and it just breaks the story and is hard to read.
Frankly, I welcome the news about the paywall since it will mean I see fewer links to their "journalism".
Has something changed in the last few years? Did they somehow turn things around?
[edit: Just wanted to point out that the events I'm referring to were about a decade ago. Concretely, before the acquisition, it seemed like the WSJ was driving something like 50% of the daily news cycle with a difficult to discern bias.
Upper management intentionally destroyed that, at least from an outsider perspective.
Reading the other comments and stories about the whole fake news phenomenon makes me think no one has managed to replicate the function they used to serve.]
But this conversation is a rat-hole. We can generate 1000 comments about any major newspaper. I think my point was just: pick one and subscribe to it.
This was one I read recently that actually made a good job of covering the real story in detail: http://blogs.wsj.com/indonesiarealtime/2013/08/26/the-strike...
https://en.wikipedia.org/wiki/The_Economist#Editorial_anonym...:
Is there any truth to that?
They don't seem to be significantly younger or more inexperienced than other journalists. However, they don't have journalistic heavyweights that do month-long investigations or pump out one price winning report after another. Those are rare anyway.
I know that they use a lot of stringers that remain unnamed. It is not unusual to have freelancers do research without naming them but as far as I know they also contribute whole articles. Likely these are people that also work for other news outlets.
Boy was that dumb of me. I'm sure I would benefit from having perspectives from the WSJ and NYT to pair with WaPo. But my previous state was having no newspaper at all to rely on, just free sites like (bleh) Slate and (unbelievably bad) cable news web sites like CNN. Adding a single newspaper to that has helped enormously.
And it's not just, or even mostly, about improving my understanding of world affairs. It's that the process I use to bring myself up to speed every day is so much more pleasant than it was before. It's like a version of the blogaverse where everything is reported by professionals. It feels kind of like a miracle.
Like I said: it was worth the money. So much so that I'm kicking myself for not having spent the money before. I would guess I get approximately as much value from the WaPo subscription as I do from Amazon Prime.
I feel genuinely sorry for you. I can't imagine reading that every single day. That's a lot of exposure to, quite frankly, a whole lot of clickbait. Don't NYT and WaPo have a limited amount of free pageviews per day?
Come to think of it, there are millions of people in the world whose primary source of news is social media like Facebook, Twitter (both news from your own circle), and Reddit (probably the worst offender? Clickbait titles generate likes, news that a small majority dislikes gets hidden).
[I had written a rather lengthy bit of text about how that's all a pretty good thing, still. Far better than hearsay and an inability to verify national broadcasting, and let's not forget that HN falls in the above category as well and I enjoy this. But this summary says much the same as the very lengthy text.]
Personally I regularly read the Economist. The additional audio format is nice; completely ad free news and you can speed up the less relevant bits. It focuses on some of the more impactful events in the world, which sometimes gives me just enough time in the week to even read news about Africa. Besides, as it is a weekly, it expands on topics in the way that sometimes I'll not bother reading the dailies when something tragic happened. Preferring to wait until Sunday to have some of the speculation filtered out. Also a company subscription to NYT, FT, and some less known ones.
But the point isn't that you can read the "important" stuff with a free pageviews. The point is that you can click your bookmark bar link for WaPo and just browse the whole site, which is an entirely different experience than just reading a couple stories from them over the course of the week in the process of drilling into a story that's trending on other sites.
Interestingly, a real impenetrable paywall makes me respect the print edition more. FT is a good example. I also like their format, layout and paper quality. But they are a financial paper so the economics are better.
I agree with this.
I would like to suggest that you extend this discovery from "daily" iterations with, as you suggest, WaPo/NYT/FT to "weekly" iterations with the London Review of Books[1]. Or the New Yorker. Both are very, very good.
Personally, I prefer reading LRB physically (with scotch) and the Kindle delivery of the New Yorker which I read with meals eaten out.
[1] LRB is about 1/3 editorial/commentary/journal and about 2/3 actual book reviews. The editorial/commentary is a very different flavor from any other media source I know of an is very interesting and refreshing. It's also quite progressive and left leaning which is interesting to me because I am not (so much).
The problem is that they aren't. Without even getting into operation mockingbird style infiltration of the orgs, the state of journalism as a whole is abysmal, even on the previously well respected journals, and I get this from journalists themselves, at least the ones with integrity.
Honestly right now my method is to simply find the best journalists and writers, and then follow their work regardless of outlet or publisher, and then I smatter in main-stream-media so I understand what the Fox/CNN viewers and WSJ/HuffPo readers, and NPR/BBC listeners are thinking.
In the end though, the problem is all of them are so tied to the money they get from advertising and very subtle but real and powerful editorial influence from the owners/investors/advertisers, that even the ones people have learned to think they trust, like NPR for example, are shining examples of propaganda disguised as anything but, equivalents of Fox news. The oligarchy has infiltrated our mediums of communication because they are a threat.
The internet is the latest version of that threat, which is why we will continue to see attacks on the freedom of speech of the internet as well.
Major shoutouts to the outliers in this equation though who are briding the gap between traditional broadcasting and the itnernet, such as CSPAN, PBS, Charlie Rose, and the universities doing programs such as Conversations with History (UCTV) and Hoover Institute, et al.
PS: WaPo has gone way downhill in their journalistic integrity lately, I expect they are a major mockingbird pivot point. The best traditional source of news I have found? London Financial Times.
StratFor (for example) seems maybe worth it but I feel like the generalist reach and short form style of big news stops it from ever truly educating. I guess what I'm trying to say here is OK, the experience might be more pleasant, but what makes you think WaPo / Guardian / NYT content is even comparably as good as a blogger dedicated to the topic? (honest question to anyone)
Here's hoping Google actually enforces their policy.
Google doesn't want people having a bad experience on Google which would drive them to consider any other source for search. If a search turns up an article and preview and a click-through doesn't show the same content, Google users will be annoyed, which will drive Google to act.
Google's anti-cloaking policy, while presented as a benefit for users [which it is], is strongly in Google's best interest to enforce as well.
That's for the normal organic search results. I don't know the policy for showing up in Google news and the carousel. I suspect it wouldn't be allowed.
Edit: You can be subscription-only and be in Google news, but you have to show the same limited snippet to both Google and end users. And you get 'tagged' in the UI as subscription only. https://support.google.com/news/publisher/answer/40543?hl=en
but, strictly speaking as a consumer, I must say their paywall is completely out of touch with the way I want to pay for news consumption. I don't mind paying 5c or even 10c per article, but I'm certainly not going to sign up to pay 120$ for 6 months, if I'm only going to read 1 or 2 articles here and there. but since they've done it this way, I can only conclude that most consumers prefer it that way.
Unfortunately I live in Australia so most stuff in WSJ I don't care about. (And we have the ABC)
wsj in particular had some rather absurd hit pieces on bernie sanders.
Why do you think the content has gotten worse?
They used to ask important questions, investigate them thoroughly and then make the case for a particular conclusion. You could agree or disagree, but now it's often just an exercise in careful fence sitting, in "being sensible", even on matters where taking a principled stand is the obvious thing to do.
That said, I'm not entirely certain if it's me who has changed or The Economist or both.
I tried it for a few months and was happy, but found out I don't have time to read articles in full anyway. I'm sure it will work for someone else though.
What amount would be close to the value they make from ad revenue?
Micropayment approaches and payment processor rates vary, but I'd generalize to probably 30% take rate. So assume 3.5¢ to 7¢ payment per article. Do you pay for every article you load? Do you pay again if you load the article twice? What if you don't like the article and don't want to pay? I don't think it's quite as simple as 3.5¢ to 7¢ because no one has really proven this model to work yet.
YOu read the first free paragraph, if you like that you pay, if you dont like the rest of the article you dont get a refund since you have already consumed the article.
Just because something cost a lot to make, doesn't mean it's worth a lot. Sorry.
But, how do you know how much value I'm getting from that news source? I usually get my news from many different sources. And sometimes, I don't even read the entire article. Only a small percentage of the articles are actually of interest to me.
Subscription feels like monogamy, I've got lots of different things to spend cash on, I don't want to commit at this scale to spending it on things I may not want.
- Average age: 40+
- Average household income: 250k+
- Average household net worth: 1.5m+
From http://www.wsjmediakit.com/files/uploads/201410/2016_WSJcom_....
http://www.wsjmediakit.com/files/uploads/201410/WSJ.com%20Au...
Also, this is the _actual_ audience not their _target_ audience.
I suggest you try to find a substitute for those entertainment pennies. If you can, and that item is "free", good for you. But I doubt 5 or 10 cents gets you much.
Not to mention that 15 minutes is a very generous estimate, the median is probably closer to 3-5 minutes. Given that the article isn't written for me, that sounds rather fair for accessing it. A print subscription to the WSJ is $400/yr or $1.30/issue, and if I spend an hour reading it that comes out to 6 to 11 cents for a 3-to-5-minute article.
Journalism has always been about advertisers and scale. The problem now is lowered barriers to entry drove up supply, reducing advertising $ available to "real journalism" and entities like nyt and wsj still have vestigial anchors pulling them down further.
Couple that with growing adblocking and it's a bad recipe. How do you put that genie back in the bottle? The net effect has been lowered standards by former standouts in a race to the bottom. I don't see a fix, much less an easy one.
According to this, it will need to mark WSJ links differently in Google News.
Interestingly, I tested it and links from Google news still had a "First Click Free", contrary to OP. To test:
1. Go to https://news.google.com/ from a computer that hasn't visited any WSJ articles that day
2. Click on a WSJ link (mine was https://www.wsj.com/articles/daniel-tarullo-federal-reserve-...)
3. See if the whole article is displayed. For me, it was, but when I tried again it only showed a snippet. So it seems like they're only showing the very first click, which does not comply with Google's guidelines above (which require 3 articles a day to be viewable). Anyone else want to offer data points?
Edit: oh, OP says it's only starting Monday.
(Of course, WSJ may be exempt because of direct communication with Google, which I'd expect anyway at their size and at the fact that they weren't banned when they started testing this. But Google should really note any exceptions in their policy.)
Just a reminder another workaround to the paywall is to you know actually subscribe to the newspaper. That is an option they offer. Obviously not possible for everyone. But if you have the money and want to read and support journalism... WSJ is really far from perfect but it's not the worst newspaper one could be subscribed to.
Also I think their discounted corporate plans program is huge, so depending where you work you may get a discount or it could be free, never hurts to ask.
Also, maybe YC could negotiate some sort of group WSJ discount for Hacker News users above a certain karma count? Just an idea...
Real subscription journalism doesn't do advertising.
We are talking serious news: the first one discovered that a minister had sent 1500 Jews in a train during WWII, the second one has discovered the minister charged of tax collection had an undeclared bank account in Switzerland.
https://archive.org/stream/commercialismjou00holtuoft#page/1...
If they want subscribers, they're going to have to do a better job than that.
$32.99 (plus tax) a month, for digital access.
Oh internet, what myths do you believe about yourself? That you are the harbinger of universal enlightenment and democracy?
"Hey, you've spent 29 hours so far this year reading 119 articles. Suggested donation: $62"
Before anyone claims that I'm being derogatory and dismissive of privacy claims, I'm claiming there's a loud minority of people that create a PR problem for companies by complaining about insignificant things.
They are also a reliable source of Tory puff-pieces, but that doesn't interest me as much.
I would support that. Might make people more aware of how pervasive tracking is.
>It's ok to post stories from sites with paywalls that have workarounds.
If this loophole is closed, will there be any workarounds? If that's the case, then I wonder if it'll still be OK to post WSJ links to HN.
A paywall wouldn't work out well for many others.
It's a concern that the newspapers which have actual reporters in the field are disappearing behind paywalls.
Not really. Radio. TV.
https://en.wikipedia.org/wiki/20_minutes_(France)
In actual print form.
It seems even older in the US : https://en.wikipedia.org/wiki/Free_newspaper
Also the transient nature of tv and radio has been changed by the internet. Most tv channels in France, be they private or state owned, give you the ability to watch older airings whenever you want on their websites. Consuming those media for most young people barely differs from a daily newspaper. You don't have to be there and sit when it airs, you do it when you feel like it.
True for physical media, aka paper news, but not so much for radio and tv. The internet didn't invent anything new here in giving free access to news, it just provides a written form in addition to video and audio forms.
> I think it's becoming increasingly clear that purely ad-based publishing is encouraging an increase in yellow journalism.
That is true but that form of mediocre journalism can coexist with alternatives. In France we still have paper news that does not depend on ads at all, and that have healthy revenue, like Le Canard Enchaine. Just because mediocre journalism can be accessed for free on the internet does not mean paper news has to die. Le Canard is one of the most profitable newspaper in France, despite requiring a subscription and having zero ads (None, at all, ever. A great tradition they've always maintained). They also have heavy restrictions on their employees for the sake of objective journalism : they cannot play with the stock market nor can they accept gifts or official honors. Just the fact that they don't have any ads at all in their newspaper sets quite a different standard from things like the NYT or WSJ. Those two keep begging for subscribers, but even if you buy their actual paper news, you still have to suffer their ads and wonder how much ad revenue can influence them. Maybe it would be more acceptable and they would gain more subscribers if they became subscriber only in exchange for removing all ads and not depending on ad revenue anymore? As a French Le Canard has proven to me and the rest of us that a newspaper can live without ads at all so I feel a lot less willing to pay for forms of news that compromise with advertisers and pollute our minds.
There is also in France, and accessible through the internet, the availability of state owned media, which is free for the poor segment of the population, and lives through a mandatory tax on the rest. It isn't quite as good as Le Canard, but still a lot higher quality than the average privately owned news. They have written form of news on websites like francetvinfo, radio, tv channels and so on. I'm particularly fond of the tv magazine Envoye Special and its in depth coverage of specific, selected topics during its airings.
Recent or not, it's an extremely important idea.
That said I agree with others that the real problem might be that no one so far is willing/able to replicate the kiosk model on the web.
Imagine if the only (legal) option to consume a physical newspaper were via subscription. Sounds absurd? It's just as absurd on the web.
1 - https://www.nytimes.com/2017/02/02/business/media/new-york-t...
I would support some kind of premium news offering from Google where they do index these and you are allowed access through a revenue share subscription made via Google.
what if WSJ paid google to index, but not give out for free? Or, rather, partnered with google so that you can pay for WSJ (or individual articles) via google's payment infrastructure?
It was also very informative.
If you can't derive value from it, I understand all the trouble people go through to bypass it. It's just that I see that people's stated aims and revealed preferences are in contradiction. Everyone wants high quality news. No one seems to want to pay what it costs.
Many news agencies are just editorializing AP news anyway.
I don't mind paying <$10 / mo for clean no BS objective and detailed coverage.
news articles have a single upfront cost, but subsequent copies carry near-zero production cost.
I'm not sure I would subscribe, but I want to live in a world where it's possible.
I want a good source of news, ad-free, and I'm willing to pay for it. Unfortunately it seems like I'm in the extreme minority.
Hopefully subscriptions will encourage better quality ads, headlines, and stories. Subscriptions do allow for less click bait.
It isn't hard for paywall website operators to use this to block Googlebot fakers. (Rather than doing a reverse DNS lookup on every request, you'd want to maintain a local cache of those results, so you only need to do DNS lookups on new client IPs.)
I believe Cloudflare already does this, and possibly some other CDNs too.
Cheaper to look for Google ASNs.
Even if you use a distributed in-memory cache to store the DNS lookup results? If User-Agent contains "Googlebot", then check for client IP in cache – if cached as "Google" continue, if cached as "Not Google" display error page. If client IP not in cache, do DNS lookup and then update cache – or, you could even let the request continue if there is a cache miss, and do the DNS lookup on another thread. That might let a Googlebot faker get a few requests through, but they'll be blocked very quickly unless they keep on changing IPs (something your average paywall bypasser will find hard.)
You don't need to consult the cache for every request, only for requests with User-Agent contains "Googlebot". (And any other bots you are choosing to let through your paywall, e.g. Bingbot.)
> Cheaper to look for Google ASNs.
How does one do that as an application developer? Do you need to speak to a BGP server?
The genuine Google requests will typically be cached quickly, and given HTTP codes, you could give a nonpermanent error whilst you're adding new entries, so there's that.
The problem is your misses may come from all over. So they're both expensive and (potentially) large.
Even if Googlebot is only a fraction of requests, it's a large fraction, and I've not investigated how many of same are suspect.
For ASN, either the CIDR Report or Routeviews.org offer information. The latter has downloadable tables, in CIDR format, for IP-based lookups. I've long advocated that this be incorporated into routing hardware with reputation data allowing for linespeed determination of traffic acceptability and rate-limiting. Shifts toward VPN and Tor are making this slightly less useful than previously, but it should still be a generally worthwhile option.
The Google loophole only works half the time at best.
All articles posted on HN invariably end up with the same discussion:
1) "Behind a paywall. Can't read it."
2) "You need to use the google link"
3) "The google link also gives a paywall."
4) "It worked for me."
5) "Doesn't work for me."
I am confused. I always thought that on HN only comments can be downvoted.
Did you mean "flag paywalls and move on"?
On other hand, for their business to continue to grow, they need to come up with way to show us that content somehow, maybe not the one they charge for but something that can display excellence.
Good examples would be ArsTechnica and Nautilus.
How is this attractive?
they're all biased liars, or at least run stories buy such authors.
This is probably a good indicator of quality.