I think I got it. Lengths will contract, but when you're moving toward something very quickly, the speed of light remaining constant, it will seem farther away. And the reverse is true when you're moving away from it.

It actually helps to just forget about relativity for a moment, and think about the angles light from distant objects will have to take to intercept you. Then it becomes more clear.