fwiw I can compile the Linux kernel, depending on the configuration, in 15-20 minutes. I usually give it 4 cores.

EDIT: On x86. If you don't cross-compile your raspberry pi kernel, you're in for a bad time.