Suppose one of the things you construct in space is a skyhook. The economical way to operate one of those is to bring down as much mass as you bring up, that way the net change in angular momentum is 0. This would change the economics of bringing space-materials down to earth.
That said, we're a long long way from being able to build a skyhook. I'm only objecting to the "never, ever" part of your post.