Perhaps something along the lines of an "ANSI terminal renderer library"? I think "render" helps suggest that it's handling the display but that the library consumer still has to handle interactivity and any UI chrome. The consumer is the terminal emulator app and this component is the renderer.

ANSI/VT100 renderer. A full terminal emulator would connect to a tty interface, run subshells and so on.