That was indeed the original assumption when the Cosmic Microwave Background was detected. The problem with the CMB, from an observational standpoint, is that it's enormously uniform. It differs by only a few parts per million across the sky. Which means that when you perform observations with less sensitive equipment the signal tends to look like a uniform noise source. But it really does come from the sky, as we eventually figured out.