I've seen this too. OpenGL performance inside VMWare is much slower than native, and there are graphical artifacts in some cases (like lines across the diagonals of quads).

Some small details (like the apparent lack of line anti-aliasing inside VMWare OGL, and differences in the rendering of translucent polys) make me think it's partially or completely software emulated.