Yes it's a big distinguishing mark between 'pagan' belief systems and Christian/Islamic systems, a belief in the moral rightness/perfection/correctness of God. Roman pagans, Greek 'mythology', Germanic and Celtic religion, all had gods who were more like exaggerated people (with all their faults and flaws and terrible behaviours) than what Christians and post-Christians think of as a god.
more like rightness
Definitely rightness, not goodness. A "good God" would never punish. Only one with an ulterior agenda (and therefore not a true creator) would resort to punishment.