Mesa has an offscreen rendering implementation that allows you to do OpenGL without an X server :

http://www.mesa3d.org/osmesa.html