You kind of have to bury X, otherwise you're going to end up with two competing projects and then you're even worse off. See: Linux audio.

If X were to disappear from the face of the earth open source programmers would scramble to get something new into place, and that would in all likelihood be better at dealing the realities of graphics today.

Just because it's the best we got doesn't mean it's good enough.

(I'm not advocating we actually should bury X... just making the general point that sometimes it's worth it to stake a step back to take two steps forward later. I realize it's often not politically feasible.)