It’s not evenly spread, though. It’s concentrated along the cable. It won’t heat up the ocean much as a whole, but it will create “hot spots”, which may change the balance of ecosystems in the regions of the ocean the cable passes through.
Worth it to stop carbon emissions? Absolutely, in my opinion.
Something that should be considered and minimized if possible? Also yes.