I did some things on-and-off for posture (mostly rear delts), but what I did consistently, and think helped the most, was heavy (for me) deadlifts.
I'm curious: how many pullups can you do? I ask because they take a lot of lat strength, and your lats do a lot of work holding up your back.