632 karma · joined November 17, 2009
Fascinating tech. I had no idea this could be done with Xeons.
https://translate.google.com/translate?sl=auto&tl=en&js=y&pr...
RDF has a high barrier to entry, and it's going to take a lot of work to get this REST API to even come close to what WebDAV already does-
* Locking
* Versioning
* Expressive ACLs
* Expressive search
* Quotas
* Simple distributed data structures
Granted, some of those features use an equally arcane XML syntax, but at least there's already tooling.Ouch.
> they've had near daily network interruptions due to DDoS attacks since Christmas of last year, with some outages lasting up to almost a day
Whoa, nope[1].
> It also leaves them highly vulnerable to DDoS attacks through exchanges.
We aggressively de-peer with networks that regularly originate attack traffic, allowing us to size our ports according to utilization rather than worst case attack sizes. Multilateral peering is actually a bit more expensive than transit these days - much more expensive if you intend to significantly overprovision capacity.
> Who else can you name that utilizes up to 7 transit providers in a given city
That's fair, but missing context. We're figuring out who works best for our traffic profile. We will scale back/remove the underperformers and scale up those that prove their worth.
> It's not cost effective, is sub-optimal for resiliency against attacks, and fails to leverage peering effectively.
All of this is dramatically incorrect.
We're actually moving to 5-10x that figure per location. We aren't playing around!
For reference, our third party monitoring measured approximately 23 minutes of downtime–
1m 46s @ 2016-09-08 01:37:53 EDT
1m 10s @ 2016-09-08 01:38:14 EDT
17m 4s @ 2016-09-08 01:40:28 EDT
2m 11s @ 2016-09-08 01:58:29 EDT
We are now capable of absorbing most volumetric attacks toward our web infrastructure. This outage was a layer 7 attack that needed to be manually mitigated.Of course the kids didn't rebuild the ABS census system in 50-some hours, and I don't think the sensationalism in this article is meant to be taken so literally. The purpose of the hackathon project and of the article is more likely to help the average person understand that the ABS could have built this in a fraction of the time, at a fraction of the cost, and given the technically trivial task at hand, it shouldn't have failed.
The CIA, in which the inspector general’s office sits, retains a copy of the full report, and is waiting for the conclusion of a legal battle over the document.
http://drpeering.net/white-papers/Internet-Transit-Pricing-H...
We've had a few false-starts, but we've finally gotten all of our datacenters dropping all traffic to these critical IPs at the edges. This should stop the most serious outages, so it's a big step.
> And it looks like the attackers decided to start things back up again, as Linode.com is unavailable...
They're watching our status page for updates and starting new attacks when we resolve previous ones. There's been an almost 1:1 correlation lately.