If this "Jupiter-sized" consciousness is allowed to have thoughts that are not "amenable to inspection". Even perhaps beyond comprehension. And the danger elides to the scale of a solar system with nothing but diamonds in it. Then, by the naysayers own logic, shouldn't all AI research be outlawed? Or at least confined to the equivalent of CDC-level-5 quarantine labs?
If on the other hand you believe that Nature has certain innate prophylactics. And that it takes more than a super will to bend the laws that govern space and time. You may be self-assured in thinking we as a species have at least a century or two before we really need to begin worrying about virtual immortals.