Selenium RC starts Firefox instances though which means I'll have to be running a X11 server on our CI box. I actually gave this a whirl with Xvfb but it still uses tons of memory.
"It takes a lot of memory" has a simple solution, after all: More memory. Recovering the cost of even $200 of RAM only requires finding one bug before a customer did!