A tool like YSlow in the browser, or http://WebPagetest.org will show you what is cached and what isn't

WebPagetest.org shows you the first time call which is generally awesome, but in this context will also show you the second visit experience which takes into account the content cache settings.