Obviously someone is on the receiving end of those repayments, but if that someone is not putting money in the pockets of those same taxpayers and instead decides to finance a power plant in Thailand then GDP will inevitably suffer.
I'm not a government deficit scaremonger by any means. I think Krugman's (and others') argument that the U.S. government can borrow very cheaply and should therefore act in a countercyclical manner for the common good is plausible. I'm also convinced that the crowding out argument is bogus in an economy that suffers from too little demand whilst corporations are sitting on tons of cash.
But we should not lose sight of the fact that interest rates are a highly psychological affair. Once trust in the ability to repay debt gets eroded things can get out of control very quickly. So we should be scared at least a little bit.
That said, the U.S is probably the one entity on this planet that is furthest away from that point. Even Japan with it's 245% debt/GDP ratio can borrow at 0.5% for 10 years whilst their currency is crashing and the central bank is announcing a massive QE program twice the size of the U.S one.
But if the U.S ever gets to the point where Japan is now, that's when I'm starting read up on agriculture or the hunter-gatherer diet.