When interacting with a real (solid) object, you only ever interact with its surface. When you touch a ball, you feel its surface. If you press into the surface, you feel that resistance as increased pressure (near-instantaneously) and you gain a lot of information about he object by that sensation (consider the difference between poking a balloon vs. an anvil) and by the reaction of the object. With sonic "virtual objects", there would be no resistance, meaning you couldn't really interact with the object in a normal sense (your hand would just pass into/through it). Even if the "user" were to understand this, it seems like the range of experience would be very limited. Without any sensations associated with resistance, could you make a balloon feel any different than an anvil?

I've spent some time thinking about this in the past, so please forgive the random tangent: IMO, the creation of virtual objects that can be interacted with and perceived as real objects will require a combination of haptic garments and exoskeletons. The haptic garments would manage any minor sensations (the fuzzy texture of a kiwi), while the exoskeleton would apply force / prevent motion. That way, if you try to poke a virtual balloon, you feel a minute jolt of resistance at the moment of contact. If you poke an anvil, you feel your finger come to a dead stop, with all of that force on your fingertip conveying the sensation of poking a heavy, stationary object.

It seems like a suit could simulate a lot of object interactions. Imagine hefting a virtual stone in your hand. You feel its texture on the palm of your hand via the haptic glove, while the exo-suit conveys the weight as downward force, applied at the wrist, elbow, and shoulder joints.