This is extremely useful and the idea of using some video RAM for the stack is genius and I'm annoyed that I didn't think of it.
According to the Wikipedia article, it had BASIC on a cartridge, and that cartridge I guess had to do the following to be useable at all: set something like the 01 and 11 bit pairs to the same color, and then store program data in spread-out bits among the video data portion of the RAM. Really weird. https://en.wikipedia.org/wiki/Bally_Astrocade