It's really important to stay hydrated, because your body often mistakes thirst for hunger. Drink water every 10m in the pool. Also, I often take a small amount of heavy protein immediately after the workout (~1/2 of one of those 33g protein bars is typical), then jump in the shower.
Between these two habits, I've killed the post-swim binge. Hope it works for you too!