INP is nigh impossible to diagnose and fix without dedicated tooling. I recently ran into what I think is a browser bug with the dialog tag that was costing us 50ms of INP.
Yeah it’s super annoying to fix! Was literally banging my head again a wall trying to fix it