I think that you are defining consciousness in such a way as to exclude everything which is not the human experience by default.

When I go to sleep, I dream sometimes. There is "a place" somewhere that I can see and hear things in my mind. It's not physical, but it's real.

If a collection of GPUs had something like that, would it be conscious?

I don't know that is true. I'm saying it seems absurd to strongly claim that it is absolutely false.