Hacker News Reader

The hard part of RL for the problems I've encountered in my work is that you need a simulator. Building a reliable and accurate simulator is often an immense undertaking.

Maybe data scientists should team up (more?) with game programmers. They have a ton of experience in building very complex simulations.

Which code is not fragile in that sense? I think that is a rather strange criticism.

You can do RL on an raspberry pi. Depends what problem you are trying to solve but not all of them require video analysis and billions of parameters.

Technical point: Value functions that are a constant multiples of each other result in the same behavior.

Making a constant multiplication mistake somewhere in the code doesn't imply the new value function would be a constant multiply of the optimal one.