Hacker News Reader

Comment by mcv | Hacker News Reader

Can you test your own bots? As far as I can tell, the rules only specify that they're automatically tested daily. I'd like the ability to test whenever I need to.

View on HN

Yes, we'll provide test game servers that you can use.

Are there limits to how much you can use them? Suppose I want to use AI techniques that require tons of tests to be run. Is that okay?

I would like to know the answer to this.

Couldn't you record the received messages and replay them?

I don't see what use that would be. If the test server was a simple data repository, it would be useless for testing algorithms.

Unfortunately due budget constraints we can't allow unlimited access to test game servers. Do you have an estimate on how many rounds would you need to evolve the algorithm enough?

No idea. I have no idea how complex the simulation is going to be. How about a simple version that can be run locally?

I would image the complexity being really high because the game is about racing against other AIs. What do you think?

And I'm afraid local versions are out because:

1. players would reverse engineer the server's simulation code

2. we don't want to give access to other team's bots

The Google AI challenges allowed one to run a game server locally so testing was only limited by one's own resources. (A bot made using genetic programming did pretty well: http://planetwars.aichallenge.org/profile.php?user_id=4038)

Reply on news.ycombinator.com