To actually answer your question, complex numbers make signal processing algorithms much more tractable, and also make it easy to visualize many commonplace quantities and phenomena in electrical engineering. Anytime a value has both a magnitude and a time- or phase-based aspect, chances are you can use complex numbers to represent it.
Put another way: just as negative numbers allow you to specify movement along an axis, complex numbers allow you to specify rotation around an axis. Both are obviously pretty fundamental.