For hardware wallets, provided there are no backdoors/side channels/JTAG holes, they are probably safe from this rig.
But, the OP's original statement: "for your crypto wallet or personal notes/ diary" encompasses by far more than merely "hardware wallets". So the relative safety of hardware wallets as a minority subset is not overall indicative of the safety of your proposed method for all the other members of the majority of the set.