Alleged $7.5B fraud in online advertising
moz.com
moz.com
Fraud is rampant. Also not new, although it is also also pretty easy to spot and block.
Almost nobody pays per 'impression' because, well that went out of style about the same time Yahoo! banner ads did.
Eventually the advertisers are going to pay for performance, and to do that they are going to have to fix the way they do advertising so that their ad, leads to their landing page which identifies who delivered the ad. Then they are going to pay based on whether or not the person who landed on their page actually buys something (service, good, or subscription). No money, no ad payment.
Most companies other than Amazon really aren't set up for that, and Amazon won't do it yet because, as far as I can tell, they aren't being forced too.
Its a shame that "affiliate" ads like the ones they let bloggers use have 100X there ROI of "CPC" ads and yet they have convinced the bloggers they can pay then a nickel and they should be happy when Google gets $13 - $23 for the same result.
I started building this system out of disgust but never finished it. It isn't that technically difficult, but it does have a lot of moving parts, and it does require infrastructure on the advertisers web site which can create durable transaction records. Some day I think.
If half of all banner ads are never seen, then that just means the cost is $10 CPM instead of $5 CPM.
Marketers then manage their budgets with this in mind.
Also, traditional display advertising (TV, Print, Radio, etc..) aren't directly measured at all. They have to go through indirect survey channels for any feedback. Yet, advertisers still use them and it has worked fine for a century+.
CPM will be fine forever. Intuitive people don't need direct measurements.
> If half of all banner ads are never seen, then that
> just means the cost is $10 CPM instead of $5 CPM.
It assumes that web sites are infinite, they are not. Delivering web pages, and processing clicks, costs CPU resources and bandwidth. A fraudster can put up a bogus web site and throw fraudulent clicks at it and steal fractions of a penny in the millions. And because it is all fake they have very low over head. But an actual web site that is putting up actual content is (hopefully) paying authors, doing research, paying license fees for images, etc.So click fraud drives the price an advertiser is willing to pay downward since, as you point out they know what they are willing to spend to get their ads shown, and it drives the price below what a legitimate web site needs to continue operating.
Or in Facebook's case the cost of combating fraud overwhelms the price people are willing to pay for a click. Same problem.
Or Google for that matter, the fact that CPC rates have fallen over the last 5 years isn't really something they have been able to fix, and its cutting into both their operating margin and their user experience as they try to make up the revenue in "inventory".
> CPM will be fine forever. Intuitive people don't
> need direct measurements.
Come back and tell me that next year on the 1st of July. (seriously I just added a calendar item to check CPM rates in July 2016). Web advertising is either going to change or die. Since there is a lot of money involved I'm betting on change.There's risk, and someone will bear, and get paid to bear, that risk. If advertisers buy on a cpa basis, they pay more for the privilege.
And frankly (imo) that's all for small to medium advertisers anyway. Bigger advertisers buy 3 month ios and, if you don't perform, don't reup. My experience at a large DSP is this: no-one comes in as a big account; they're all grown. You get $50k for 3 months and told to demonstrate performance. If you do, your account managers call up and demand 3-5x the money. Wash rinse repeat. You do get $3-$5mm/year accounts, but they all started under $100k/3 months. And in any case, all DSPs / ad networks will be measured on a cpa basis. Don't perform, and next quarters ios don't materialize. They're just not sold cpa.
If you aren't aware, btw, there are huge fights about attribution - last view is ridiculous but what most people use, leading to all sorts of gaming behavior particularly in light of cookie churn.
Lets say I'm content provider A, I get your ad and it has an encrypted URL that lands back on my site. When it lands on my site I can decrypt it and know who sent that click to me and note it. Then, on conversion, pay that person.
The challenge this system has is that it doesn't let you throw your ads into a distribution bucket and wait for them to land on some site that is buying some traffic from some traffic provider. You have to know the sites (and presumably their IP addresses) where it lands. I need a relationship between the site showing the ad, and me. Then I can be sure that anyone who clicks on that ad, and then buys something from me, I can credit the sale to that site.
What is useful (and to some extent different) about this scheme is that you can compute ad spend against revenue generated. There is no 'fraud' because you don't pay unless someone "converts" (the term for making transaction). What it does do however is cut off all the shady ad networks and packagers and skimlinkers and what not because they don't add value for a large brand like Macy's or Target or Amazon.
So a blog like TechCrunch with a relationship with Target can give target an exact number of how much business has arrived at Target because of their ad on Techcrunch stories. And Target can compute exactly how much revenue the clicks that landed there from TechCrunch generated. And from their existing understanding of life time value of a customer who has landed on their site and made a purchase, they can price the value of that advertisement fairly precisely. TechCrunch gets feedback on how much their ads are worth to Target and can choose to make every ad a target ad if they think it will maximize revenue, base on the performance not on the click through rate. Target could lie about conversions, but that would be self defeating in the long term (they want people to land on their site and want people to carry their advertising).
If we learned anything from the meteoric rise of Google as an advertising behemoth it is that people will pay for metrics and demonstrable results. If you can provide the best metrics and the best results, you win.
(1) multiple retargeting providers repeatedly bring user X in
(2) once user X clears his or her cookie and becomes user Y, we no longer have a way to target ads to him or her. If he or she then revisits the site, our analytics become confused and that user is entered anew into a retargeting pool.
(3) user X is exposed to ads from multiple ad partners. Who owns the conversion? Fractional share / time decay / last view through? We can track the partners that showed this user an ad (up to cookie churn), but somehow must apportion the credit.
Users regularly repeatedly visit a site and are exposed to multiple ads before converting -- that's a big part of the debate over who gets credit.
The above problems become more acute as you exhaust retargeting and move to lookalikes or other forms of prospecting.
The current flow is this: advertiser pushes 1-party data into an exchange or ad network, either directly or via a dsp or dedicated company ala liveramp or via retargeting partner. This can be as simple as "target this user" or very complex, eg catalog integrations ala tellapart.
With no cookie, how can an exchange or network know that anyone wants to show an ad to this viewer?
The other possibility is a single company sees all / has global ident ala fb and google on mobile.
Also, you keep coming back to multiple parties having a claim on a conversion. That is fundamentally unrelated to cookies. It's this: multiple parties showed an ad to a user. Forget, for now, how that user was identified. If that user then converts, which partners get how much credit?
> how do I identify people to target?
Publication demographics, backed up by readership surveys. (I know pretty old school but it passes muster even in Germany for privacy protection) Places like TechCrunch survey their readership and identify demographic characteristics that you might want to target. (age, sex, buying habits) > With no cookie, how can an exchange or network
> know that anyone wants to show an ad to this viewer?
Because they have already made the decision based on the readership, if the publication keeps identity information and demographic information it can share it with the advertisers. Their is no "risk" of showing it because they only pay on conversion, there is only the publication wanting to get better at showing the correct ads.How that would work in practice, if you have a login with a publication they can share demographics about that login when they ask to get an ad[1], if not they can share general demographics.
> multiple parties showed an ad to a user. Forget,
> for now, how that user was identified. If that
> user then converts, which partners get how much
> credit?
The partner who got brought the customer gets 100% of the credit, everyone else gets 0. For generic items statistics will have that conversion happening randomly amongst all the possible places it is shown. For non-generic items the partner that got the reader to the point of doing the conversion "wins" that particular round.As you have surmised it does not support the notion of building an ad network through the use of cookie analytics. However I suspect such tracking/monitoring networks are going to be put out of business by a combination of privacy laws and browser changes. They are already considered "bad" by many consumers and transitively by those consumer's representatives in government.
[1] Caveat the privacy policy of course
Disorganized thoughts:
Your ad solution sounds to me like a trip back to advertising 10 years ago -- lots of brand ads / dems targeting. Surveys are pretty crappy; high income dems tend not to respond; people lie; most publishers don't collect regdata; etc. Obviously a handful of pubs -- those used as proxies for rich demographics -- would love this (nyt, ios review sites, bmw/mercedes fan clubs) but for most pubs it would be a loss.
Even with lots of direct response ads there is too much inventory continually driving ad rates down; I don't see how removing a bunch of demand would improve anything from most pubs' perspectives.
Publishers uploading regdata also brings its own privacy problems.
Sounds like an incredible market opportunity.
What are the companies that are building ad marketplaces targeting high performing affiliate bloggers which demonstrate their value better to advertisers, and share a higher proportion of profit with the bloggers?
Are there fundamental issues trying to scale up a business like this? Not everyone can spin their own custom 'sponsership' packages like DaringFireball, but there is a lot of good blog content out there.
I remember seeing some bespoke ad networks in the designer space, can't think of their name off-hand. Had the feel of a high-end web ring, if that's not an oxymoron.
I've setup a system that tracked that.
The result was a 95% drop in payments for referrals.
While trying to sell this, I heard multiple advertisers say that they only buy TV ads because it would look "weird" with their hierarchy if the company is not on prime time TV, despite knowing that TV ads are hardly profitable and nearly impossible to measure. The same thing goes for billboards on roads with heavy traffic in the capital.
This already happens. It's referred to as an "acquisition" and "cost-per-acquisition" (CPA) is a fairly standard term in the advertising industry these days.
However, it doesn't necessarily involve money (e.g. a car company might define an acquisition as someone signing up for a test drive).
That assumes that you can actually measure performance or attribution. This is far from a solved problem. As such many publishers are reluctant to sell on this basis.
Trivial rebuttal:
User clicks on ad, buys product. Who's to say that ad caused the sale? Maybe they've seen that particular ad or a variant on dozens of different publisher sites. Or even better, maybe the true product awareness was driven by an offline interaction (billboard or word of mouth).
In the general case, you simply cannot measure direct attribution or performance with any real sense of confidence.
Strategy-wise the solution is simple, but digital marketing is intrinsically flawed nowadays and it's one industry that could literally be turned upside down at some point in the coming decades as the internet evolves. And I think a lot of people wouldn't mind that - especially the people with the power to bring the change (i.e. developers and proponents of open source solutions and haters of crappy spam)
You would try it out with a few hundreds or possibly thousands first. If it isn't showing any return at all, something is fishy. You wouldn't with a sum that would hurt to lose.
Then nice thing about the web is that we can measure and analyze user behavior.
Marketing is a case of art meets science. You need to make sure the total spend is net positive. Also it sounds like you do this a bit on the side. I'd really recommend getting a professional to help if you have the scale or a scalable business. Treat it like an investment. If you can get $1.30 back for a $1 in, go nuts and grow. You'd be amazed how common I find businesses that treat marketing as a cost center, refusing to invest more even when it's proven there is a significant positive return on their spend.
Advertising fraud is basically arbitrage. The fraudsters are inflating the numbers but someone is still willing to pay a specific value for the traffic they're receiving. If a specific market is more prone to fraud, its because the amount publishers are paying is below its actual value.
Exactly. Brand-awareness media buys tend to rely on third-party web traffic "experts" like Alexa, comScore, Hitwise, Quantcast, etc. These tools are incredibly simplistic and count the majority of fraudulent traffic as legit. When a site ranks highly across these experts, it is then used to increase the CPM a brand-advertiser ends up paying.
It's a nutty way to run a business, but in the short-term it can pay the bills for lots of folks.
http://i.imgur.com/sW1stNL.png
A lot of the traffic they charge for on the display/content network is still awfully iffy. I get spikes of traffic from blogspot blogs that didn't exist the day before all the time. They won't exist a week later. How likely is it that a new blog with a single uninteresting post suddenly has tons of traffic interested in clicking my ads? Not very.
@dangrossman I build white lists rather than a black lists for companies where I handle their marketing for display on mobile. Not sure if your offering something like this in Improvely but I imagine it would be of value to a bunch of clients. Advertising networks will hate you!
My son clicks ads and whines about it nonstop when I let him play iPad in his games.
So, it becomes an ROI game, which as long as ROI is strong they can keep their rates up while keeping their profits climbing. Then again, Google's top line has been shrinking recently, so it is possible they are doing something about it, and it is hurting them. That or it's the general shift in advertising to focus on mobile where it's much harder to get engagement.
PPC campaigns feel like a shell game to me often times. Agency switching among advertisers is staggeringly high as people hunt for higher ROI.
If you're a brand/marketer, I recommend two easy things to increase your ROI: (1) Make sure you are not being charged for GoogleBot traffic. Seriously, for frequently updating sites, self-advertising GoogleBot can account for up to 10% of all impressions. Ad Networks can easily filter that traffic out. (2) If you're paying per impression, work with partners that charge on viewable CPM.
Second, I think simple tests like "time spent on ads" as a trigger is an extremely simplisitc, inefficient and likely inaccurate way of determining "potentially not human." The systems here are very complex, designed to mimic randomness within humanesque constraints.
You're right, "time spent on ad unit" is simplistic but it's not inefficient. It shouldn't be the only thing in your arsenal but it's a good signal.
I reckon you are also overestimating the amount of sophistication that goes into these systems. The ones that are out for purchase in a black market become well-understood within a few weeks and are easy to fingerprint. Since the network is paying on net-30 days, there is some time to retroactively run some analysis and filter out provably non-human traffic.
Over half the images are incomprehensible or offer no insight.
>https://upload.wikimedia.org/wikipedia/commons/c/cb/Clickpat...
Including an unintelligible graph without an explanation to why it's necessary is bizarre. Even more so writing headers like "Responses to the scandal" and dropping in a stock photo of a gavel. It's like a pull quote, but even lazier.
There is some value in this article,
>Hoffman, the retired ad agency CEO who I quoted at the beginning, puts it better than I can:
>http://adcontrarian.blogspot.co.il/2013/06/the-75-billion-ad...
Even the author suggests to read this one instead.
Now I'm not saying that means anything... but it always felt a bit odd like... yes yes we know how bad it is, take your money and shut up and keep buying those ads
I'm the author -- and I'm completely amazed. Thanks to whoever submitted this, and thanks to all the upvoters! I'll be going through the comments and responding when necessary. Feel free to AMA!
Oh, there seem to be a lot of interesting stories here from people who worked for ad companies and related firms. Feel free to post your comments on the original Moz article -- I'm sure the community there would love to hear about it.
This is mostly a problem for unsophisticated players and exaggerated hype originating from players that support tracking view ability, etc.
Aren't most customers of online ads unsophisticated users? The solution could of cause be to let a professional online ad company run your buying, but then you still don't know what they're doing with your money.
I believe that most of the people are running their online ad buys as if they where bus stops ads. That might be wrong to, but that's where the business needs to start.
I am in the paid media business, and I am not disinterested either as such. I feel strongly that advertising is the lesser of evils of the alternative is marketing messages buried deep in content and social spam.
1. They do not sell marketing services. They sell marketing software.
2. I pitched my article to them, and they were very skeptical about the topic at first. Obviously, the issue can come across as very conspiratorial and sensational. But once I showed them all of my credible sources and citations and explained everything in-depth, they decided to publish the piece.
3. Again, I cannot speak for Moz, but my sense is that they will publish anything that they perceive to be very helpful and interesting for their audience -- digital marketers. They more that they do so, the more that their brand will grow among their audience and the more that people will visit the website to read the good articles.
I founded, ran and sold a digital advertising company in the video space. We sold through various means including networks, direct sales and quasi-direct sales where we would engage a local syndicate to sell on our behalf. These were usually major digital publishers that used to be print publishers.
These people are moving a _lot_ of the volume in this industry. They're battling widespread redundancies and falling budgets. They are not attracting the cream of the crop and are in an unfamiliar industry (tech).
Guess it's so easy to sell to clueless business owners that taking 10 minutes to learn about the crap they are peddling isn't even worth it.
$7 billion over meany years, while it seems like a lot, is still just a small amount of the total advertising online market
The figure may still be exaggerated and more research is needed. It could include things that are mistankingly called 'fraud' but instead if a misunderstanding of terminology
In a free market, online advertising fraud would depress prices as advertisers pay less due to worse results. If advertisers were getting 100% human traffic, rates would go up, making the ads more expensive.
So in the long-run it balances out. But on an individual level it sucks getting scammed.
The whole scheme was of dubious value for the advertisers, obviously. The ad networks were happy to have us, though.
By that, I mean, who's paying for bots to generate this activity, and what do they gain by it?
edited :)
Doesn't this model only work if you are driving traffic/clicks to _your_ site? What is the benefit for bots that are hitting other people's sites?
That's the "convince the network the bot-generated activity is genuine" part. A site where all the "people" clicking ads are never seen on other sites stands out like a sore thumb. Having a bunch of background benign-looking activity lets you hide other kinds of fraud, too: http://krebsonsecurity.com/2014/07/service-drains-competitor...
Maybe the reason you notice them and they bother you, is because the amount of your attention that that experience has to take up has to be so great that your peers' attention is worth the payment even when that attention is divided by 10 (if we assume 90% click fraud.)
In other words, given no other change except eliminating payments to non-person audience members, you might find the Internet is suddenly filled with advertisement that violently takes only 1/10th as much of your attention as currently, since the money is being spent on you and your peers only; and not on you, your peers, and then botnets and other dilution.
Put yet another way: the leakier the transaction between you (real user) and advertiser, the worse the experience you have so as to make up for it.
Let's put some numbers on it!
Let's say everyone is happy to buy a banana online and the profit is 20 cents. Then if click fraud is 0% and the cost of an ad is 1 cent, a 7% click-through is fine: it costs 14 cents to get a customer, leaving 6 cents profit. Any more than 7% click-through is pure profit.
But raise the click fraud to 90% and suddenly 7% won't do it: the real ad cost is now 10 cents, and instead of 7% click through you now need 70% clickthrough.
So the ad will be much, much louder.
And you figure that'll make the ad-haters click it more?
Also, that 10cent ad is much more ripe for the picking than the 1cent one. All of a sudden you're attracting click-fraud attention from far more sophisticated attackers. And driving more "normal people" to ask a techie to hide these annoying dancing bananas (and all others ads at the same time.)
I don't really think you've thought this through to the endgame.
But nobody is perfect, no market is perfectly rational and efficient, and at the end of the day the quality of advertisement that next to no real person sees must be different from one where every impression paid for gets seen by a real person... (including you and me.)
It would be a strange world otherwise.
More likely, the ongoing fraud is driving the prices down. Once the fraud stops, cpc would go up.