Hacker News Reader

Comment by SonOfLilit | Hacker News Reader

I gave it a few minutes and got nothing.

Maybe try for something even simpler than MNIST, so we can get the great immediate feedback effect of http://playground.tensorflow.org, which I consider the important aspect for learnability?

View on HN

There's just no point getting fancy for MNIST. Using nothing but fully-connected layers and rmsprop, I got good results in less than one minute. https://imgur.com/a/7xzmQ

Hidden units for discriminator layers - 100, 40, 2.

Generator layers - 40, 100, 768, then "reshape" into 28x28x1.

what you're showing is basically perfect discriminator with awful generator, isn't it?

Yeah ok it's pretty misleading. And if you let it run longer the generator starts getting a little better. It took me a long time to figure out the UI.

well you have the example on the left of graphs.

Unlike regular classification, it's hard to quantify the performance of a GAN by just looking at the loss curves. You really have to make a subjective evaluation by looking at the generated images.

By playing around with it, the results I got from fully connected were nowhere near as good as the results I got from convolutional.

Default parameters on MNIST should give good results in 5 minutes give or take - depending on your hardware. Can you show what you got?

That's what I got after 10 minutes on GTX1080 - https://imgur.com/a/4Ba9u

Looks about right. The default setting is as basic as you can get. No transpose convolutions, batch norm, and other tricks for better GANs.

Did you click "train"? Otherwise it's just doing inference from random data.

Thanks. Doh.

In Israel we have a classic song that goes "if you're cooking spaghetti and the water doesn't boil, how about turning the stove on, because that's what everybody does"

Reply on news.ycombinator.com