That money is (presumably) benefitting the whole state, whereas you're looking to take all that money and just benefitting the small part where you live. Not really fair.
I hear you.. but I'm guessing there is actually a larger number of people that would benefit from the bay area being less congested than the number of folks riding a bullet train to LA