Have you looked at either Raylib or SFML? Both are somewhat high-level graphics abstraction libraries, but neither are anywhere near the weight or functionality of a proper game engine.
https://www.raylib.com/ https://www.sfml-dev.org/
Or is something like this not what you're looking for?