1. Display resolution is still quite low, so really everything is blurry.
2. You will never be able to notice blurriness where you aren't focused anyway because you aren't looking there! Everything is always blurry in your peripheral vision.
3. Surely eye focus is a feedback system, like in cameras? I mean nobody has problems focusing on TVs because your eyes just magically change focal length until the image is sharp.
I am stereoblind so maybe it is a big problem for others.