As far as the job market is concerned, I wouldn't worry at all.
A few caveats:
1. Give up any expectation of owing a home (to be precise, a single-family home with a yard) in Silicon Valley proper.
2. If you want to follow the conventional path of marrying and raising children, then marry a someone who can pull the same compensation as you (software developer, doctor, lawyer at white-shoe firm). You can't raise kids on one income here (you can't send them to private school, for instance) unless you are absolutely certain that the public school system will work out for your child.
3. Be prepared to be very lonely if you do not have a friends' circle already established here. It is difficult to make friends and connections and keep up because of the all-consuming nature of work and distances involved (e.g., Palo Alto to San Francisco takes 1 hour minimum, so expect to spend 2 hours simply on driving to and from your friends in the City or down in the Peninsula or South Bay).
4. If you are old (i.e., 35+), then you will have more difficulty getting into good jobs. Ageism is rampant and job interview processes are geared towards young or unattached people who can spend a great deal of time on tech interview prep on an ongoing basis. As changing jobs regularly (2 years is now considered the norm) is the only good way of keeping your comp at market level, expect to be in interview mode for at least half your tenure at every job (assuming your tenure is 2 years).