This is essentially the philosophical zombie thought experiment: https://en.wikipedia.org/wiki/Philosophical_zombie