Kind of what I don't get about people calling AI conscious. Because it's multiple GPUs,maybe even across multiple racks, and not even the same GPUs each time. Is the whole data center consciousness then?
Look at us. We generally agree that we are conscious and our rack is atoms, molecules, cells. Those atoms of Na and Cl I had yesterday have been in a rock for most of their existence. Did I make them conscious by moving them into my body? Or is consciousness some property of the electric fields inside my brain and the biological layer is only a way to keep them going?
The same words that form a book can be printed on paper, carved on rock, drawn on sand, stored on a HDD, punched cards, SSD, learned by heart and never written down, etc. But it's the same words. So are the media really important?
There's no defined system with llms. A piece of software runs multiplication on various pieces of hardware. There's no thing to be conscious. There's no state or before and after when the next token is predicted. Your response might even be cached. A GPU runs one person's mat mul,then another for a completely unrelated request for someone else. What is the entity that's conscious?