The problem comes when their misconceptions have consequences to those around them. If somebody consistently swaps "left" and "right", that is fairly harmless until they start driving on the wrong side of the road. If somebody believes that there is a child sex ring operating out of a pizza parlor, that belief is fairly harmless until they take a gun to that pizza parlor.