Here's an example page from Amazon's preview:
http://img26.imageshack.us/img26/8082/screenshot20120118at14...
Note the musical extract, the heavy use of blockquotes, etc. It's pretty much a worse case for an ereader.
PS: I'll admit I'm a bit late to this party, as I just bought my copy for the Reddit readthrough, and it's the first actual dead-tree book I've bought since my Kindle. I too was annoyed at first by the lack of a ereader version, but after reading the first few pages of the intro I couldn't imagine reading it any other way. This is a VERY dense book where I often find myself flipping back a page or two to reference earlier material.
http://27.media.tumblr.com/tumblr_ksx9yp5KRO1qznraho1_500.pn...
It's also a great example of the mindbending trick-prose hosftadter gleefully employs through the book.
EDIT: Here's another: http://26.media.tumblr.com/tumblr_ksjw79NLay1qznraho1_500.pn...
(I'd buy the physical book, but there isn't even a Czech translation that I'm aware of, so no publishers here have it in their catalogue.)
I remember a couple of bits where you get multiple levels of nested indentation, to the point where the text started half-way across the page, and those would be difficult on most e-reader screens.
You would lose something when converting to ebook, no doubt. But the convenience might also make it worthwhile.
(Stretched analogy: I have heard that Pink Floyd's vinyl album Atom Heart Mother was cut so that at the end, it just kept playing the inner ring in a loop instead of finishing, so you got the repeating sound of a dripping tap. That would be lost as an mp3, but I'd still rather have the digital version.)
If you had a large format reader that could do PDF properly, that could handle it though.
Unfortunately, I don't think we'll see an eBook edition too soon. Hofstadter describes himself somewhere (in the GEB preface, maybe?) as very picky about the layout of his books. I remember him saying that he would sometimes rewrite sentences in order to make the layout better.