Your post describes exactly what I have been through. For me, it went away when I built more confidence and got a few friends.
How did you make the friends at work, if they were at work? Did you just keep talking at them until they felt forced to respond?