Yea! I thought along the same lines, but I wasn't sure how to write it out. If X is on a spectrum, and Y is removed, it's closer to not-Y.

Edit, eh your explanation probably explains it better anyway :)