Probably not. "Steal the shirt off someone's back" means to take everything from a person, even the most basic and least significant item of clothing that they are wearing, and leave them with nothing.