The Potential of Probabilistic Computers

This seems like the obvious thing to do with neural net problems... Not clear on what makes it hard/risky. Are we essentially saying, "Build a CPU of CPUs?"