"The Best of Leonard Cohen" isn't a bad place. It's from mid-career, so not exhaustive, but most of the songs on it are gems.