I do organize my books by genre (IT/science, high fiction, low fiction, history, non-fiction, language learning).

... and then by size. It's the most aesthetically pleasing for me, genuinely.