Indeed, investing in just the S&P 500 would be an example of poor diversification: you'd limit yourself to US large cap stocks. By recommending the S&P 500, Warren Buffet is saying, implicitly, that he believes in US large caps to the extent that he does not even want to diversify.