2,408 karma · joined October 3, 2010
I maintain a database that's over 1TB and Oracle handles it very well. The trick there is understanding that, under absolutely no circumstance should you ever need to do a full table scan, because the table isn't designed for that.
So, I'd argue that a monolithic database is okay even up to 10TB even with slower disks as long as you never need to touch more than 10% of it. If you need to touch 100% of the data 100% of the time, I'd say anything over 100GB is too big for one machine.
The reality is that it just depends. There's times where you're going to want a hadoop cluster even for only 16GB of data, and there's going to be times where a database is going to be fine with 10TB of data.
http://en.wikipedia.org/wiki/Margin_of_error#Different_confi...
In reality, you should apply a finite population correction, which would make the "margin of error" a bit smaller if you get a substantial percentage of the population voting:
http://en.wikipedia.org/wiki/Finite_population_correction#Co...
Do you accept that the median salary if you are black is less that 2/3 of that if you are white?
You comment on the stats of single mothers in poverty, say we need to turn it around, then and pretend it's an easy problem to solve when these communities don't have the money to fund programs at a local level (since they, you know, live in poverty), coupled with a history of racism and neglect at the state level, and you just say "well it's not really a problem because more white people are poor and we should end affirmative action"
Affirmative action seems pretty targeted to me. Sure white people don't really get affirmative action (that's not really true because there's all sorts of advantages you for just being poor), but life's not always exactly fair.
With some complicated magnetic fields, you could probably do something smart to take advantage the different charge/mass ratio of an ionized atom and positron and minimize interaction with a steady/confined positronic cloud. You might be able to annihilate enough electrons of the dust particle to ionize it enough to subsequently deflect it from the ship. Then you'd still have to worry about gamma ray radiation and back pressure and maybe some other interactions.
I don't really know about all of this for sure, just a thought.
While I was telling a story, someone told me "tl;dr"
I had to ask what that meant, and people started laughing.
I soon realized I wouldn't be hanging out with anyone who identifies as a redditor on a regular basis.
Near IR is generally up to 1400nm wavelength, where the infrared from heat isn't really a factor til you hit 4000nm.
The intensities of NIR are too low to be worthwhile.
The scientists made something that could see your remote control's LED, not your body heat.
Or, you know, you could always just ask what size a golf ball, and bus is.
It seems to me the only assumption the question makes is that a person could make some logical assumptions about the question, ask some logical questions, or ignore all assumptions and parameterize the answer.
In addition to this, there's levels of processed data. For example, raw data is usually level 0, and basic processed data is level 1 Processed and calibrated data is usually level 2, etc... but experiments often have different definitions for each level. Reprocessing of any later can happen at any time, although level 1 reprocessing is usually an extremely intensive operation because it operates with the largest amount of data.
Level 0 data is usually heavily compressed when it's left on disk, because it's typically the largest amount of data, but also least touched.
Most scientists will use level 2 or level 1 data. This data will be on low latency clusters.
So, while CERN has petabytes of data, typically a fraction of that will be accessible.
In the past, level 0 data was often left to tape. While the raw data is still backed up to tape (I know this is the case for ATLAS), for many experiments with large amounts of data they might leave it on lower cost HDD in simple RAID arrays for redundancy and not worry about performance so much. The BaBar experiment has done this for their long term data analysis.
In addition to all of this, it's still occasionally easier to transfer large amounts of data via tape instead of the internet.
The reality is that IBM is no longer consumer facing, and neither is their research. MS still is and has to be (and losing), but IBM just abandoned being a household name a while ago, except with things like Watson.
I worked at such an experiment for 4 years.
In practice it's significantly more difficult to optimize all your code based on deep knowledge of architectures, compilers, and even compiler versions than it is to just let a JIT compiler optimize at runtime.
2. Ideas for parallel implementations of nuclear fusion have expanded, and as a result, funding and research has arguably become fragmented and resources have been diverted. In reality, there's a fixed amount of capital and knowledge (which is also a function of the availability of money) available for this kind of research. The amount of money the US puts into fusion research is quite paltry compared to the potential benefits. It may be a priority, but the way Washington spends money says otherwise.
Scientifically, fusion is maybe 10 years away. Politically, it's more like 40 for a real power plant, but with the current congress, I couldn't say. In addition to that, it's an expensive enough endeavor that it would be corporate suicide for a private company to attempt it, especially considering the majority of companies with enough capital to pursue something like fusion tend to be in the Oil and Gas industries.
If you can remember to scan when you get on (which doesn't fit the "normal" behavior of a paper ticket either) then you can remember to scan when you get off. It's no different than BART, the main difference is BART funnels you through an exit. If you have a round trip commute, then you are going to enter and exit at nearly the same points.
Why? Because Google's business model is so heavily dependent on highly accurate maps at so many levels. There's been posts on HN regarding Google's usage of Streetview/OCR to improve their map directions, and it's absolutely critical that their maps be the absolute highest quality in terms of content and accuracy of that content for their driverless cars.
Google has and will continue to invest massively in maps, and no user feedback will ever approach that investment.
In general, paper based phenolics were used for tons of things, and if you have anything around that looks like hard plastic that was made before the 70s you've probably encountered it as well (buttons, knobs, etc...). The trade name Bakelite was a general term to denote a paper/linen/cotton based thermoplastics.
It's simple, clean and standardized, but I can still look different everyday. I can pull an alternate when the time is appropriate and dress up nicer, like for a date. Most importantly it's unoffending to the eye.
A google/grouper/conference t-shirt is offending to the eye. I tend to have a whole lot of preconceived notions when I see someone wear those shirts, usually it's related to their lack of a social life.