Yeah well, context is king. The aim of the Turing Test is to say that judging machines based on their internal structures isn't very fair, since that's not how we judge humans. There's no real way of knowing about other people's "qualia" or whatever you want to call it. To skirt that problem, Turing suggested a behavior-based approach.

I think we probably judge others to be conscious actors in more ways than this though. We probably accept that other people have "qualia" from the fact that we have it, and then we kind of learn that our parents have it, and so on, until it's not a huge leap to generalize that to all of humanity. Of course it's not like people have always assumed the same kind of "qualia" for all of humanity, in a lot of conflicts this has probably been thrown out of the window so it will be easier to kill your enemies. Either way, it's probably quite complex how we determine that other people are conscious, Turing tried to skirt the metaphysical issue (that we can never really know, this goes for both humans and other machines). I think this was a huge step in the right direction.