Your hand might not break, but it still really painful.
Breaking a stack of 6 with a knife hand, my wrist would usually be sore and bruised up the next day. It would take a week or so for full mobility.
I still think most people in the world wouldn't be able to break 2 pavers with no spacers. :)