The religious reason is generally about seeing insurance and/or investment as gambling, as I understand it. I wouldn't call it that weird.
> Also utility bills are a valid proof of address for some reason.
Well, yes. A utility bill means that there's a highly-regulated company that is providing you a recurring service to that address, billing you at that address. If the electric company is billing you at a house, for providing electricity to that house, presumably that is your house. It doesn't seem especially unreasonable, it's going to be more up-to-date than the record of when the house was bought or when you started a lease, and it's cheaper than sending a government employee to verify. It doesn't have to be a hard, unfalsifiable proof; it only needs to be stronger evidence than writing down whatever address you like without any checks.