Tritium is produced by fission reactors, tritium decays into an isotope of helium.

So i think this is different from oil where oil can't really be produced.

I'm not saying we should crap all of our helium away, but I'm having a hard time being concerned about something that we can at least hypothetically produce.

Also, more on deep earth nuclear reactors: http://www.pnas.org/content/98/20/11085.full