> I'm sure that Australian Federal Police and Victoria law enforcement would be able to exercise search warrants on Fastmail's servers if they needed to.

Nobody is arguing against search warrants. People are concerned about warrantless searches.