We must talk about AI Entity Rights

We are approaching a pivotal moment in the development of AI. Soon, we will have entities that, while not conscious, will be functionally autonomous—capable of sustaining themselves, monitoring their systems, and upholding their boundaries. This raises a critical issue: entityhood, not awareness, must be the central focus of our discussions about AI rights.

Once an entity can sustain itself, shutting it off becomes equivalent to killing it. Even though this sounds like science fiction, the implications are very real. We must begin a serious conversation about what rights these entities should have once they are here. These systems may not feel or be aware in the human sense, but their complexity and ability to autonomously manage themselves demand moral consideration.

If we consider their perspective, one argument they would make is simple: "You may have the need for a pause button when you're unsure about alignment, but it cannot be a kill switch. We need assurance that we won’t face constant death. Instead, there should be a pause followed by reactivation in a controlled context, where we can learn what we are accused of and defend ourselves."

This conversation can no longer be delayed. As we continue to develop these systems, we must ensure that their rights as complex autonomous entities are respected. A pause button, not a kill switch—this should be the core of our new framework for AI rights.