I hear you. For months I had my Oculus sitting in the corner of the room gathering dust. Unlike a phone, it's not pinging notifications at you all day so it's easy to forget about.
But you know that saying "come for the tool, stay for the network"?
Right now, we are super early in the adoption phase. You can tell by looking at what fraction of your Facebook network are on Oculus (in my case it's about 2%). That's why most of us are playing solo games which feel a bit like mere novelties.
But now that all of my work colleagues have one, I'm using it heaps. The value of VR grows the more your buddies have access to it.