You're allowed to say no to your investors. In this case it sounds like you probably should.

$100k isn't giving you much runway in SV. You won't be able to hire anyone, and would soon be out of cash and have to leave (you'll save a portion of your cash for that right?).

If there's something you really want to move to SV for, come for 2 months, stay in an airbnb, and do what you need to do. If you need to and can, raise more money (investors or revenue) if you're set on moving here.

In your OP, you said you have multiple investment sources. How much of the 100k requires moving to SV? Consider how long it'll take you to build the business to profitability. Consider the increase in rent. Consider the cost of your move. This could be netting you absolutely nothing.

My advice, FWIW, is to really think hard about what others here are saying as well - don't move just now. Do your investors have a really good reason for you to go there that is provably critical to the success of your startup? Many of these people just want to keep their investment where they can see it. As someone who has moved countries frequently (now on my 8th) I can tell you that it is massive investment in terms of time and money, both of which you are probably better off putting in your business. The USA and SV aren't going anywhere, they will still be here in another year or so (at least, i'd like to think so) when you are past the helter-skelter startup days, and will be in a position to create some more breathing room. In the meantime, nothing stopping you from popping over when it is absolutely required.

Your investor is being unrealistic. You can barely hire a single developer in SV with 100K. I recommend set aside a traveling budget of two weeks or in two or three trips so and do what you need to do.

Another option is to not take their money and build the business yourself.

And don't underestimate the cost of living in Silicon Valley. $100k would barely cover your expenses for a year, maybe even less. Nevermind hiring other people and growing a business.