You’re showing a lack of empathy for the instance of yourself that is experiencing all that pain. Simply forgetting it doesn’t make it right to not have empathy for the version of yourself that went through all the pain and suffering.
Bear in mind that the "version of me" is me, and cognitively is in agreement that this is fine. Instinctively I would very much not think it was fine while undergoing the pain, but I'd also think I was wrong about that at the same time. I don't suppose I'd be all stoic about it like Giles Corey*, but it's the cognitive side of me that has the valid opinion and eventually the executive function.
*Squashed to death in Salem, 1692