We've had close to a 100 years of drug prohibition which disagrees with this notion
An llm as is is simply a tree. It cannot produce speech by itself, and even if it did modern robotics are not considered citizens (we can deal with that when it comes).