I do the same thing! If there's a book I want to keep, I scan it with my DIY bookscanner and toss the book away.
I, too, used to dream of having a big home library. Now I dream of a home with almost nothing in it. (If it weren't for music scores, which I use at the piano, there wouldn't be any books in the house other than what I'm currently reading and hasn't been scanned yet.)