I share your fond memories of the Gravis Ultrasound. It was expensive and fiddly to setup, but when it worked, it just sounded so awesome. Nothing else really came close until the AWE32 came out a few years later.
I still have some old PCs somewhere with various GUS soundcards in; including some rare ones like the GUS MAX and GUS Ace. I was surprised to see that GUS hardware in good condition is selling for hundreds of dollars on eBay. I guess I should dig them out and see if they still work.