I think what bugged me was the lack of drive-by readers.
HN is pretty much the only site I submit to. I have no aspirations of blogging as a business. I blog because I want to, and I'd blog if nobody came by. So heck with the score or the front-page status. And no, it doesn't bug me that a large percentage of what I write is not home-page material. That's okay too. Hey, I got used to being a mediocre writer many years ago. It's all spray and pray now.
The problem is that as a submitter you'd at least like to get a decent second set of eyeballs on your work. The value the site provides to me as a submitter isn't making the front page -- it's getting the feedback from readers. No initial readers, no feedback (good or bad)
Sure, there is a bit of sour grapes here. I guess you'd think if you spent a long time writing something that in return you'd at least receive a reasonable review. But if the average number of initial reviewers is decreasing for everybody, it can't help but mean a decrease in the quality of material overall. So it would seem that my problem as a submitter, even a submitter of poor quality material, affects the quality of material on the site for all users.