Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by mratzloff | Hacker News Reader

Full thread

mratzloff·

I wasn't able to play the video for some reason, but I located it on YouTube:

https://m.youtube.com/watch?v=ZisFfiEdQ_E

For comparison, DeepMind:

https://m.youtube.com/watch?v=ePv0Fs9cGgU

Note that 550 is a very low score in Space Invaders.

View on HN

Not OP but I believe the low score is due to not enough training time and incorrect parameters such as frameskip. Space Invaders was mentioned as one of the few games they needed to lower the frameskip (from 4 to 3 or 2?) on because of the flashing lasers. I'm assuming OP left the parameters as is from the implementation by Nathan Sprague, which has frameskip at 4, and trained for a few epochs.

Changing the frameskip is not needed any more since the implementation does max of last two frames before processing (same as what DeepMind does)

EDIT: talking about Sprague's implementation btw, not necessarily OPs.

Actually I did both frame skipping and amxing out two frames as reported in the Natures letter

https://storage.googleapis.com/deepmind-data/assets/papers/D...

I noticed that the video does not work in Safari.

Interesting. I am not sure how this deepmind game was played. Note that a typical game with epsilon = 0.1 achieves results around 550 points. In the nature paper they were running the game with epsilon = .05

If you spot any other differences I'd be happy to learn about them.

Isn't the score based only on the first level ?

Reply on news.ycombinator.com