204 karma · joined August 27, 2010
<groupname>.irc.slack.com
Google the internets for username & password setup.
How's the disk io on that linode VPS?
That's your first problem. I bet the schema isn't normalized and these are all varchar columns.
~~ Normalize your schema ~~ such that the main table is a set of integers. JOIN on PK and index whatever is required. Trust me, MySQL is fast when you do it right. I have tables with 650M records and lookups are just as fast as day 1. Keep table size AS SMALL AS POSSIBLE (less columns, use ints, etc).
Use date_ids & time_ids (from standard DWH techniques) if you are storing datetimes, not datetime fields (default indexing them is 1 second resolution which is stupid).
I want to see your slow query log.
Here's what bugs me about all the people chiming in about how messed up this all is. It's like you all think we live in some sort of utopia whereby we are the only ones doing this sort of surveillance.
Every single sophisticated foreign intelligence is doing this back at us, their citizens and their enemies - probably with more resources and state sponsorship. China, Russia, Israel, Iran, etc. Why wouldn't we continue to push the boundaries and try and have a leg up on this? Should we bury our heads in the sand and hope that China doesn't pwn our entire national electric grid? (google it)
Additionally, these actors are directly targeting and stealing intellectual property, reverse engineering and compromising state secrets in order to gain military & intelligence advantages directly from US based companies (see Boeing - google it).
State actors are embedding backdoor trojans into US destined products (example: look at the wikipedia page on Huawei)
Fundamental extremists do exist and want to destroy Americans at any cost (including their lives). Why wouldn't we surveil their cell phones, email and IM accounts?
Before every gets up in arms about this, consider the world in which we live first.
And the NSA, apparently.
As tptacek mentions, breaching perimeter security from external is "game-over" in most cases.
I just wouldn't trust having something critical like "impersonate user" on the open internet - even if secured by https + 2fa.
Bastion servers if properly firewalled might be OK for a short term solution. The concern there is if you allow unfettered ssh (for example) is someone watching for the inevitable brute-forcing that will ensue?
"Our support tool includes an 'impersonate' feature that enables MongoHQ employees to access our primary web UI as if they were a logged in customer"
"Oh noes, we aren't 3 steps ahead of them, they are 3 steps ahead of us." Fuckin-a they are and I'm glad.
Getting rid of scumbag terrorists, child porn shitbirds and spying on foreign adversaries is fine by me.
And yes, I already know the comments will be "what if they designate you a terrorist some day". I suppose I will cross that bridge when that happens.