There is active research addressing this problem, for example https://www.usenix.org/system/files/usenixsecurity25-park.pd...

But yeah, difficult too :)