Now, y gets smaller because some people pay off their loans in one go, to refinance somewhere else (the whole presumption is that only those who won't default will refinance); the expected interest becomes zero. But x stays the same. So y - x gets smaller. Hence, your number in the 'assets' column gets smaller; a write down that is counted as a 'cost' at end of year. You do get y in the assets column (the money that is paid back), but without the expected interest.
In other words: non-defaulters will keep serving their debt, earning the lenders interest. Defaulters have to be written down, including the interest. The less non-defaulters there are, the worse the overall portfolio will perform. If you estimate a performance of x at year t, and in year t + 10 it turns out that you need to revise the performance to (0.8 * x), then that 20% is a write down - i.e. a cost.
The whole thing to realize here is that the 'cost' is not an actual loss as in 'less money comes in'; it's a cost in the sense of 'this portfolio will perform less than we anticipated'. And if the interest that people pay is based on a certain overall performance, but now all of a sudden the performance needs to be adjusted downwards, then one might argue 'we were shooting for a 0-operation, but in the end we will have to spend money to make up for the good borrowers leaving'.
Here's another intuition that explains it: if the market is willing to finance the good borrowers at half the rate it takes to lend to everybody, regardless of their prospects of paying back; then only the bad borrowers will stay in the government-funded portfolio, reducing the performance that was originally estimated. Which is, if you've accounted for future earnings based on the original estimate, a loss when you have to write it down.
The problem is not "oh noes people are paying us back" it's "well crap, the private sector is undercutting our legislatively defined interest rates and we will be vastly under target on these returns."
If the government never "had" the money (again, in the accounting sense, loan payments are pretty stable investments normally), then they can't lose it (as in your counter-point). However, if they did "have" the future money (in the accounting sense), and they can no longer expect that to come in, they are in fact losing money (again, on the books). In these cases, there's no actual dollar bills flying out of the window, just some accounting projection spreadsheets somewhere that make people unhappy.
But what I'm really objecting to is the conclusion that the future loss of interest represents a loss of income, when they now have the principal back and can invest that in the currently best way possible. If what you get from those funds today is significantly worse than the projected income from those loans were, then it seems you are implying that student loans really are meant to shaft the people who take them out.
If you pay off your loan/mortgage early then the bank won't get all the future interest it expected to make — the bank only made [START, PAYOFF] interest instead of [START, FULL-TERM] interest. Some loans even have "pre-payment penalties" to favor the bank over the consumer in such cases.
And that's entirely beside the point that "not making as much money as I had hoped" is not the same thing as "lost money".
It depends on how you account for it. Technically you shouldn't assume all your future interest is materialized (IANAA), but if you run forecasts and see you have a million people who owe you a billion dollars total on a 7% interest rate over the next 20 years, you expect to have, within reason, that money.
If something incredible happens and all those people suddenly pay off their loans this month, that drastically changes your future (especially if your loans were at a higher interest rate from the past you can't re-charge today).
Maybe we should take pre-payment penalties as a sign to negotiate a lower interest rate.
The government not wanting to fund education is bad enough, but trying to profit from it with loan-shark level interest rates is insane.