If you are serious about getting into SDR, having background in DSP can take you very far. Most of the painful SDR dragons are based in stuff that was optional at university time, but is otherwise not that hard to pick up once you know it exists.

Understanding the frequency domain, why it's useful, and how to get there & back, is like 80% of the puzzle.