Hacker News Reader

How would more AI help? "given this goal with these parameters, figure out if another AI will ever game it into eventual thermonuclear war. "

Feels halting problem-esque.

View on HN

My point was that instead of blaming ML - or optimisation tools really - for gaming objective functions and coming up with non-solutions that do maximise reward, AI could instead be used to measure the reward/fitness of the solution.

So to the OP's example "optimise a bike wheel", technically an AI should be able to understand whether a proposed wheel is good or not, in a similar way to a human.

Reply on news.ycombinator.com