Against a Madoff perhaps, yes. But the point is rather that the FBI probably doesn't need to respect the rules outside of the US.
Here's an article on using the FBI as more or less another branch of special forces: https://www.washingtonpost.com/world/national-security/insid...
That's not how this works, that's not how any of this works. They don't operate at all outside the US. :)