That's begging the question as to whether awareness arises out of the physical world. You're assuming mental activities arise out of computations occurring in the physical world, when whether or not this is the case is in fact the question.
Why? Because the person in the computer, being a faithful simulation of a human mind (or some AI analogue), will say they feel exactly the same mental things as real humans, down to the most minor detail. You then see they are just software, and say it's impossible to prove they feel the subjective experience they claim to feel.
Then they say you're just a dude and it's impossible for you to prove you feel this subjective experience you claim to feel.
There's no way out. If it's possible _at all_ to have self-aware software, they will have exactly the same claim to consciousness as yourself. Which is: I can't show my mental state to anyone and you need to take my word for granted.
Of course we think that humans are special, but a gerbil, a cauliflower plant, even a metal spring does this. Granted a cauliflower can do much more than a spring, but then a gerbil can do more than a cauliflower.
https://nautil.us/issue/104/harmony/plants-feel-pain-and-mig...