Similarly, "pets can't do my taxes" is a reasonable statement, because it is implicit that it doesn't include hundreds of years of genetic engineering and cyborg implants.
You've misunderstood the comparison analogy. It's showing two situations where implicit timeframes are important when people talk about what is "true", where the second one makes the importance extra-obvious.
"Pets doing taxes" could just as easily be swapped with "cold fusion generator in your garage" or "rocket-ship for personal commutes."
If you're trying to figure out how LLM weights are like the weights of a rocket payload, then you're going in the wrong direction.
Those who think future systems could have consciousness would explicitly say so, indeed I have talked with a few who clarified as such. On the other hand I have seen a lot of statements that simply state without further clarification "software therefore not conscious".