Now that I'm a year out from my previous job, I can talk a bit about what I did back in the 2010 timeframe. By the time I'm able to talk about what I did for them in 2012, it will be ancient history.
And yet, my career has been full of interesting work and I regularly get inquiries for neat sound jobs based on (as far as I can tell) nothing more than my having a pulse. It's true that, on occasion, someone who's familiar with my work contacts me. But much more often, it's someone who has no idea what I've done who's desperate to hire because, nowadays, everyone is desperate to hire.
I expect that, one day, the job market will cool down and I'll have a bit of trouble finding something I really enjoy. But, from where I am now, the tradeoff seems worth it, even if that day is tomorrow.