167 karma · joined August 9, 2018
I think the species that was imitating the cell phone was a rose-breasted grosbeak, and it wasn't nearly as perfect as that Lyre, but close enough to be recognizable.
When I see patterns in traffic coming from 45,000 one-off hosts for a month straight it is clear that there is a distributed botnet behind the requests.
When I see a vulnerability scan from an Azure cloud instance seconds after I ban a block of Russian addresses, I can be sure there is coordination.
And don't get me started on the Moldavian Registration Bots. Those are a combination of automated and human-assisted CAPTCHA solvers, and it took me almost a full week of careful observation to weed them out.
These are some of the things my application firewall can detect automatically. Every now and then I see a new pattern, that is all I was trying to say.
We just weren't getting enough information from Bing or Google Analytics or CloudFlare, and when I developed a realtime activity dashboard, patterns started emerging: distributed web scrapers, registration bots, vulnerability scans, and some of these in tandem (i.e., scans commencing immediately after blocking a block of addresses). And many of these are coming from cloud hosts, Azure being the worst, with Google a close second. This is the type of traffic they don't want you to see, so those respective analytics services just supress it because it would be a negative advertisement if we could actually see what is happening realtime. I compared the numbers - Google was consistently underreporting our traffic by at least 40%, and a lot (not the majority, but enough to be noticible) of that traffic was coming their own hosted servers (not the indexing bots, but the user cloud instances).
CloudFlare implements temporary bans but I needed something permanent for those threats that were recognizable based on their request patterns.
The ARIN squatting is the latest thing I'm seeing - a lot of requests coming from netblocks that are former DoD and RedHat addresses. The publicly available ARIN databases aren't entirely up-to-date and the bad guys know it, some of the checks we depend on have to be taken with a grain of salt.
So far, I've been able to develop business rules to separate out the human activity from the carefully constructed scraper/probe attempts, but I fear that if they get just a bit more sophisticated I may lose that ability.
They are so late to the game. Just yesterday there were articles here about subscription fatigue. After GoT ended, I dumped everything except a minimal Hulu subscription, and I'm starting to wonder why I'm keeping that around.
I have a lot of questions about this, including how they plan to sell me on their subscription model, which will clearly compete with the backlog of shows and movies that were already bought on iTunes at a price they were notorious for commodotizing, in addition to the other streaming services that they offer over their own hardware (Hulu, Netflix, HBO, CBS), all of which have their own content monopolies. The one thing that might do it for me is if they managed to get a monopoly on BigTen Network, that would get them a dedicated customer for 6 or 7 months out of the year, depending on how the season goes.
GDPR recently drove us to build our own application level firewall from scratch, which turned up behavior that is never reported by CloudFront or Google Analytics - those services are only hiding the severity of the problem.
https://security.stackexchange.com/q/91717/78662
However, if these are hosted on the same server, there is a long-standing bug in Apache that forces the same protocol and cipher suite for all virtual hosts: