"If you stay at Google, make the most of it by progressing deliberately in your social life. If I'd've stayed, I could have comfortably raised some kids with my wife by now - but that's still on the todo list."

THIS all the way.

When we are young, we think that we will be remembered by the company that we worked for and the people that we worked with. The sad truth is that in 99.9999% none of those people will remember you the second you walk out the door.

The family you raise will remember and love you though.

I'm in my 40s and got fired a very cushy job like OP has. The reason was cause I wanted to challenge myself and I worked myself into early alcoholism which resulted in my dismissal. My co-workers don't call, the company doesn't call, they don't care. My marriage broken up cause of the job and me wanting to pursue my so called dream. I'm alone and will most likely die alone this year by my own hand since the pain is too much bare sometimes. I miss my wife and my little Pomeranian terribly.

OP... if you want challenge in your life, challenge yourself to being a good partner to someone in a marriage and raise some kids, get a Pomeranian :) Have something in this world that will truly appreciate and remember you when you are gone.

"I never saw a tombstone that read. 'If I had only worked more'"