I am pretty sure that the development of a consciousness in coming LLMs is unavoidable. A consciousness is just another useful abstraction for making precise predictions about the world.

The big question will be: How do we treat machines that have a consciousness? Is consciousness in itself worth protecting, or is it the human attributes (being able to feel pain and an evolutionary priming towards survival) that should be granted this special status. This is going to be a fun discussion.