Deep Fake Detector Extension by Mozilla Firefox

Well, as long as it's not as unreliable as LLMs.

Agreed, although trying to name things in modern tech is like playing minesweeper but the board changes every round.

See Lora vs LoRA and many others.

I'm cool with using the word Deepfake for text. Generated text should generally be referred to in the derogatory, considering it very rarely adds anything of value.

I've heard of a startup that claims to be able to achieve a near-0% false positive rate: https://www.pangram.com/our-model/how-it-works

They appear to basically RLHF a model on a bunch of examples of human/AI output on the same prompt. Not sure how well it works, but I'm guessing Mozilla is doing something similar here.

  > Don't most AI either incorporate or surpass GAN architecture

No.

Most generators don't bother because it is time consuming. Maybe they will if there is a popular detector like this. But it sure increases the cost of training and do people really care? Probably not unless you're explicitly trying to create subversive content. It's also important to remember that tuning a model can also have adverse effects. Sure, you get better in one way, but that can often mean you get worse in another. There's no free lunch.

To "Um AcKtUaLlY" you, GAN is actually a training technique, not an architecture, though we all know what you mean. Maybe worth noting, that our GAN based networks tend to result in much smaller and faster generative models which can thus produce higher resolutions with much lower resources. The best face generators are still GAN based btw. But you still need big architectures to match diffusion models and you tend to lose your advantages (not all, but it gets nuanced).

  > making good software detector impossible to build?

It is a cat and mouse game. I'm not sure there is anything wrong with this, but detector systems tend not to be continually updated, aimed at specific models, and I think their communication is very unclear. You should never say anything is 100% generated, it should be "suspect." So "low suspect" to "high suspect" but never "not AI generated" or "AI generated." The communication is problematic and leads to kids getting flagged for plagiarism when they just wrote something generic.

Though tbh, with a lot of the LLM based detectors, I am really confused by the methodologies. Like why is there this big focus around perplexity? LLMs are trained to be entropy minimizers, so it really doesn't make sense to me that detectors are often looking for... entropy (since perplexity is scaled entropy).

Not necessarily passed off as real, but otherwise yes.

Elon should definitely pass a law that "deep fake" can't be used to refer to text. Otherwise what's he going to do with twitter?

I had the same reaction - but I guess images was just the first obvious application of fakes. ai text is similarly fake in the same vain

Sounds like a company version of ADHD.

Vertical tabs, tab groups, usable profiles - all upcoming non-AI Firefox features.

The version history goes back to October, wayback agrees with that.

Detection algorithms can be less useful in general if they're public and open source, eg. website operators sometimes mass ban on a delay so they can trap a lot of misbehaving users and don't immediately tip off the suspicious behavior.

Although in this case it's already a publicly available extension so even without the algorithm details you could easily check your text against the detector and tune it until it passes... but maybe having the method be public would make it easier for users to prompt engineer the AI to write in ways that wouldn't be caught by it.

>People should be careful with these extensions. It's one thing if they have a GitHub or GitLab repo, where people can easily check out the source, developer history, or any issues presented. It's another thing when that's not the case. Many of its reviews are not promising either.

Someguy posted this immediately deleted his post. It only had a 62% chance of being human. Comical because the ai didn't realize that the Dev is mozilla.

Yes, this is a lost battle. Ask for a specific way of writing to defeat most existing system. Gain access to the review system to defeat them entirely.

Mozilla is cooked because of the DOJ vs Google lawsuit. Google has been overpaying Mozilla to keep Google as the primary search engine in Firefox, but once that goes away they'll have basically no revenue.

How Mozilla lost the internet (& what's next) by TechAltar: https://youtu.be/aw-XYrMFb0A