I couldn't agree with you more. I've been wanting to learn Clojure for years now, but I'm not going to fight with an IDE for hours to do so.
Edit: You really don't need an IDE for clojure. A repl and a text editor are your best friends IMO
Have a friend who as learning to program. He got Cursive going in less than 30min
I'm not saying that to be snarky, but I'm just pointing out how quick it actually is.
brew install leiningen
lein repl
<begin learning clojure>
The thing is that most Clojure users are/were heavy Java users and they feel awkward without their IDEs and also some have a big java project that hey mix with clojure.