Could it be a small black hole?
Or is it just a matter of us not spending the time/effort to find it. I know time on instruments like Hubble is very, very tight and scheduled out years in Advance. But they have been talking about Planet X since like the 80s at least, and probably earlier.
Even Pluto was detectable relatively early and it’s on a crazy orbital plane and elliptical orbit.