No he means personally vote him out. Only the residents of Morley had the power to vote him out, which they did of course (thankfully!)