I'm pretty sure (unverified claim) that the "cold" description got linked with the illness in pre-germ-theory-of-disease days, where being outside in the cold for too long would imply one "caches a cold" when they feel ill the next day.