I'm curious how far away we are from a robot that can pick up LEGO pieces and stack them together according to the assembly-booklet.
And what kind of DL models would it use?
And what kind of DL models would it use?
It turned out to be much more complex than I expected.
The biggest issue was grabbing. Typical approach for this type of task is to use vacuum suction actuator, but it does not work for Lego parts, because they have stubs and prevent suction from working.
Also there are issues of part separation.
We abandoned this idea, but I still hope that we can return and achieve something working some day.
That's an AI I'd rather not see though - that's the fun part OF LEGOs. If you really want a model completed, pay a local teenage (or laid off software dev) to do it.
So you are saying it is not possible to stack LEGO pieces by a remotely controlled arm (with a human operator)?
> That's an AI I'd rather not see though - that's the fun part OF LEGOs
AI is already claiming all the fun tasks like writing poems and drawing kittens ;)
This is something you can probably program an expensive assembly robot to do if it has to repeat that same procedure thousands of times, but doing it for a whole set human operated? That only makes sense if you haven't got a set of nimble appendices and opposable thumbs, and you have the time to spare and inclination to train with the remotely controlled arm. Having an LLM do it seems fruitless at this point — and why bother?