Yes, you are being too paranoid. Once booted into Openwrt the router will only be running Openwrt code. I guess there's the tiny possibility of a backdoored bootloader but that would have to be a pretty sophisticated backdoor!