Agreed. Aside from a few major variables (fixed-width or variable-width, anti-aliased or no, weight), and ruling out fonts with obvious flaws like making 0 and O look too similar, it's largely a matter of taste.

I've found that some fonts look much better as light text on dark backgrounds, or vice-versa. I use terminus (http://shenani.gen.nz/~scott/img/terminus-sample.png), but something about it doesn't look right to me on a light background.