Federal tax refunds are not income. Does the IRS send you a W-2 or 1099 for them? Are you writing them in under "other income" or something? Unless you're doing something seriously weird, they aren't income, aren't reported anywhere as income, and aren't taxable.
For state/local taxes, as smoyer points out, if you erroneously deducted a larger amount of state taxes than you actually owe, then, when you get the difference back, you have to correct that on the next year's form, if you had claimed the larger amount as a deduction. If that weren't the case, you could game the system by purposely having your state taxes massively over-withheld, deducting the inflated amount from your federal taxes, then receiving a state tax refund.