I still have a Commodore 128 that has a second Z80 CPU just for running CP/M. Really weird in retrospect.
[1] http://www.cs.cmu.edu/~dsladic/vice/doc/html/vice_2.html#SEC...
I guess the close to the metal, with little to no memory protection barriers, made these kinds of things easy to implement.
That said, some early GPUs were somewhat similar.
The 3DFX cards used pass through VGA cabling. And i personally owned a PowerVR card that wrote rendered frames back to the graphics card over the PCI buss.