Not sure what profession you refer to but in physics you publish to specialized journals in your field of research. The referees typically have some, if not a lot of expertise. It's not like a random guy is giving a thumbs up or down. It is a critique of your scientific work.

Having been a referee for a long time I can tell you that so much submissions are just minuscule variations on existing papers that are sugar-coated to be ohh so important contributions to the field that it is mind boggling. And if you decline it, they try the next journal with a lower impact factor until they get published.