Do note that Authentik, being a Python project, still uses a decent amount of RAM IMO.

I think Keycloak 18 should use less memory? Might be worth a try.