Not if you expel an excess 500 calories per day on the toilet. This is what would happen if you chug a glass of olive oil, for example -- your body won't digest it all, and the vast majority of it will pass straight through.

This is an extreme example, but I make it to demonstrate a point 'calorie couters' always seem to forget: You keep assuming that you retain 100% of the calories you ingest, minus what you burn. This is demonstrably incorrect.