OP here, apologies if this is not suitable for HN. I posted this not as much for highlighting the fact that datadog does this. But rather in the hopes that there might some discussion about alternative approaches and maybe some critique.
So from the look of this, this is something I have been trying to find for some time. I guess only way to tell if it's as good as it seems is to try it. If anyone else knows any alternatives for doing anomaly detection in stats, open source or other services it would be great if you could share it here.