If I'm correct, I believe you only pay taxes when you realize the gain. So if you never sell you'll never owe taxes? Can someone confirm this?
You only pay capital gains taxes on them in the years where you sell.
Keep in mind that in the IRS's eyes, any exchange (like BTC -> LTC) counts as a sale, and so does buying goods with crypto (like buying a video game with BTC).