I always want to be able to respond with an actual answer if someone asks me "Do you know 'x', you are connected with her/him on LinkedIn". Otherwise, it's really just a waste of both of our times since I think improving your connections with the people that you know somewhat well is the true key to using LinkedIn well. That connection could be as simple as
"I met them briefly at a conference", but it can't be non-existent.