Why can't you combine .tar.gz files with cat?

I'm not familiar with the internals of how tar and gzip work, but I would have expected the exact opposite result if I had to guess.