For the ESP32, an hero is in the process of adding LVGL[1] to ESPHome[2][3]. You can try it out now: https://github.com/esphome/esphome/pull/6363
Here's the (very good!) preview documentation: https://deploy-preview-3678--esphome.netlify.app/components/...
This is such a game-changer for me that I'll be using the ESP32 over the ESP8266 for any projects involving displays from now on.
[1]: https://lvgl.io/
[2]: https://esphome.io/
[3]: ESPHome on HN yesterday (500+ points): https://news.ycombinator.com/item?id=40138228