Yes but it's symmetrical.
If result A then calls for second referendum greeted with derision by side B
If result B then calls for second referendum greeted with derision by side A
So no conclusion can be drawn by the fact that people are partisan. The question of whether a second referendum is a good idea is independent of the result of the first referendum.