The non voters are routinely used in discussions to lower the results of various parties. The message is "in reality only (a small) percentage supports them" (and then a ratio voters for that party / total population is taken).
What I am trying to say is that the people who did not vote do not exist in these statistics. Taking them into account is just a tactic to lower the results of competitors.
Additionally (but this is utopia) these people should not be allowed to comment in any form about the situation of the country (but again - this is utopia of course)