Its not necessarily that he wanted to take it off, it may well be that he just didn't want to keep it on.