Fraudulent tax refunds are a huge issues that the IRS has not kept up with. The IRS itself estimates it paid $5.2 billion to identity theives[1]. Protecting taxpayers without creating too much of a hurdle to tax paying is a very hard problem to solve.
[1] http://time.com/money/3419136/identity-theft-social-security...