Objectively, this depends a lot on where you live, and subjectively, on how you perceive your government and society. Regardless, you can opt-out.
You argument makes sense if a state made organ donation mandatory, but I don't think any country has such a law.