I don’t think you become Press Secretary of the White House because of the salary, you become Press Secretary because you are passionate about it. (For all you cynics out there: replace “passionate about it” with “power hungry”.)
You certainly don’t have to feel ashamed or poor at cocktail parties if you are the Press Secretary of the White House, I would much rather suspect that you don’t actually have time to go to any cocktail parties and that that could be the much larger problem.
Press Secretary is not a job you have forever (eight years seem like the natural maximum) and I’m certain that you have great chances of landing a highly paid job after that.