OK but how is it that other countries get by without them for founding LLCs? Are there countless scams going on in the UK surrounding limited company for example since you don't need a notary there?

There's often lots of post hoc justifications in Germany for "why it is that way" (and has to be that way). But nobody ever seems to stop and think: ok but the rest of the world seems to get by OK without these reams and reams of bullshit?

The problem with Germany is not that it is stuck in the 20th century and completely backwards, but that nobody seems to care that it is. Worse, if anything there seems to be a degree of pride among Germans of the "process". As soon as you criticise some piece of particular bullshit German bureaucracy (as opposed to bureaucracy in general, which generally you're permitted to criticise) then they start circling the wagons (often pointing to other countries where the situation is supposedly the same or worse). So it is never going to change.