In traditional dry stone construction, strength of each rock is determined by sound and by sight. It seems crazy, but nowadays this should be feasible with a neural net. If you want to get fancy (or achieve high reliability) add ultrasound in the grippers or other sensor modalities.
Or... you target a market other than building foundations? :) I suspect different groups could pursue both paths.