HA Proxy has been doing this sort of thing for a very, very long time.

You have stick tables and a very rich way of populating them and then you can use these tables of in RAM data to make routing decisions.

Sometimes you need another proxy too - eg Apache/nginx or whatever, perhaps for authn/authz.

Yes it is a tricky concept and this series of articles merely scratches the surface. Good effort though.