It's very likely there are fewer than a dozen people that have ever held >100,000 Bitcoins. That would take two weeks of mining every single block in the days of 50BTC coinbase rewards. Reasonable estimations of Satoshi's mining vs. others in the pre-GPU days makes 100,000 very tight for more than a few individuals. This would also require continuous mining for several months unless you were the only person mining (which isn't the case for anyone but Satoshi). Hardly 'for kicks'.
If you look in old forum threads, you'll see that many people mining in 2009 and 2010 mined several blocks over few days or weeks of mining. That would net a few hundred coins, and sometimes a few thousand. The majority of mining was done this way. The opportunity for many individuals to mine 100,000 simply was not there. If you actually talked to more than one individual who did this, you probably met 2 out of the 3 biggest Bitcoin miners ever.