Nvidia Vid2vid: High-resolution photorealistic video-to-video translation

Are you sure they're amateurs, not professionals don't it for fun (/pro boner/!?!).

Adobe have definitely bested most oss competitors in their space. Although with the amount of man power at their disposal it would be hard to beat.

On average I agree they are on par. Sometimes OSS is better (ffmpeg), sometimes commercial stuff (adobe after effects).

In this specific case I think it might be beneficial if you can spend a lot of money on gathering training material and tweaking the network. But then again someone here mentioned the quality 4chans fake porn has reached, so maybe I'm wrong after all.

MS Office is still miles ahead of any OSS “alternative“, despite the many glaring bugs.

The gaps are massive in several electrical/silicon CAD verticals and simulation. Due to IP secrecy, no OSS Verilog/VHDL synthesis alternative exists for Vivado/ISE/Quartus and the Intel/Xilinx line of FPGAs. I don't think any practical alternatives exist for Mentor Graphics' line of silicon design or simulation software, nor have I seen any OS software capable of complex mixed domain simulations like COMSOL or Ansys - many of the pieces exist, but it takes a lot of work to verify that algorithmic physical models actually work together.

That's equally horrifying in a different way.

Maybe but only after extensive proliferation.

Initially, every Tom, Dick & Harry script kiddie will try to blackmail people whilst the public and justice system is not really aware of the technology possible.

When eventually enough of the public is made aware to not trust photos and videos anymore then these types of blackmail attempts would be less effective. But there will still be less informed gullible targets.

Yeah... The problem is try explaining deepfakes to your significant other when they are randomly sent what looks like a video of you cheating on them. Sure it’s possible but not likely.

DRM will be pushed hard, starting from video/audio acquisition, perhaps assisted by blockchain to keep footage verified at all processing steps.

Someone's gonna come up with a simple way to sign pics and videos with public key encryption, after which signed media will be the only stuff that is trusted. Of course people will still make sex tapes and sign them when they are drunk because the signing software will be automatically integrated into the camera app, so blackmail is still a possibility.

That would require an entire team's worth of skill, preparation and work. This could be done with a few already existing medias, and a single person behind a computer.

"Starting now"? How's about 5 to 10 years ago. This is being released free now, which indicates to me this is now disposable tech and the authors have much, much better in their labs.

This is how their model was trained, but I think what you've said may not quite be the case.

Because the discriminator (D) and generator (G) usually compete in a minimax game, the equilibrium probability of D correctly classifying an image as fake tends to 1/2 (ignoring distributional factors). If the competing networks have enough capacity and can be stably trained, then in theory they will reach equilibrium as the data distribution from G converges to the actual data distribution. If this is the case, then the discriminator correctly identifies fake videos with a probability of 1/2.

They may not reach equilibrium (making D > 0.5), but it's not clear that the discriminator itself is a panacea for identifying fake videos/images.

The whole GAN thing is useless though if neither of the models have a concept of symmetry or that those pixels do represent actual solid objects in space. Modern neural nets can't represent abstract spatial and semantical concepts or reason, so that videos are full of glaring perspective inconsistencies and large-scale artifacts. So nope, neither AI can help to "identify fake videos", nor do we need AI for that.

The problem is that it's a game of superhuman cat and mouse.

We'll have systems arguing with each other and no way to tell which is correct. If, for example, someone is able to get a copy of the forensic AI model, they can train their decoder/generator to work against it until the results pass as legitimate. With no human ability to argue with the results of the forensics AI, we'll just trust it and pass it off as truth.

If you can clone the jury and conduct a quadrillion private trials, your chance of success in court is going to increase substantially.

Things gonna get creepy.

Well plus electricity. A DGX-1 takes 4 kilowatts or so that 10 day training run will take just about a megawatt hour or about $100 at retail. So the cross over point is more like 23 runs :)

yeah, but does not look like something many hobbyists would try for fun ;-)

Or you can build your own 8x2080Ti rig which will have 80% of performance for 1/10th of the cost.

I wonder, since the NN cores of the GPU are used for real-time raytracing, will they be able to run custom NNs possibly not related to visual stuff in parallel to the ray-tracing stuff?

Edit : found the answer on Internet, apparently the RT (raytracing) cores are different and separated from the Tensor (NN) cores on the RTX

Nayghty America:

https://www.theverge.com/2018/8/21/17763278/deepfake-porn-cu...

Also see the film Marjorie Prime.

https://en.m.wikipedia.org/wiki/Marjorie_Prime

Yeah. https://www.youtube.com/watch?v=fkE6RBlfbXA This isn't the worst one, there was a time when PKD's daughter interviewed the head and he went off on a rant about how much he disliked his family. That was really rough.

Looks just like edge detection + contouring from RGBD data.

The hardware they used costs tons of money, and so does doing on a cloud provider. It’s not something to do in a weekend with your gaming card.

It's already being used for quite a while and you talk as if you aren't aware of the fact. Quite Ironic.

I assume they are talking about signing/watermarking a video in a way that survives video encoding/lossy transmission. A QR code probably wouldn’t work for various reasons but is an easy mental analogy to think of.

Yes, but it just cuts out the face and pastes it on a different person/background. It does not do full reenactment where you keep the entire target video environment.

Her(?) face morphs slightly in the first few frames.

or pretrain the network on the movie you want to compress, then ship cartoon compressed version + trained network.

Can't you easily obfuscate that by making the video intentionally grainy and low-res and passing it off as "caught by CCTV" or "found footage"?

You say 'pretty obvious artifacts' but that is because you have some clue about the process and know what you are looking for and are interested enough to look.

I tried pointing out to some friends some really bad artifacts in a video we watched, and they just could not grasp it. They couldn't see what I was seeing as it didn't look out of place to them. It isn't for lack of intelligence, they just didn't care enough to understand. That pretty much describes vast swathes of the population.

You show a video using the above technique to anyone with strongly held political/ideologic beliefs and an inclination to accept 'alternative facts' over actual facts and videos using these techniques will be like a wildfire and almost impossible to refute!