> The "penalties" are just what you owed plus interest
Sure, interest after 6 years can accumulate into a nice penalty sum on top of what is owed. If IRS ends up owing you, and they discover it 6 years later, would they send you the refund with an interest as well? I am guessing they won't.