I have recently been in, what I think is this situation. I didn’t speak to my boss from April ‘20 through to last month. From my POV he trusted me to work with other teams and choose my own priorities - he’s in quite a unique place in our organisation where he’s pretty high up but has his own “branch” where he hires people directly. However, there are definitely people who he does ignore because it’s easier not to have to deal with them or their problems (and can’t remove for other reasons), but from the outside there is little to differentiate the situations.

However, although the freedom was nice, it didn’t really do anything to focus my career, challenge me to improve, or advance in the organisation politically - so I switched over to working directly for one of the teams I had mostly been working for anyway, and a boss I already have a good working relationship with.

If you don’t have the working relationship with your boss that you feel you need, and don’t see them having that relationship with others - then maybe you need to consider a change. Hopefully it’s not so completely hopeless that you can’t tactfully discuss it with them, at least.