This is very clever. Now I'm wondering if someone has looked into optimal partitions and instruction streams. This would allow, in theory, to run any AI graph locally by partitioning the graph and loading it one piece at a time.

But anyway, if someone has $80B I can get this done. It's just an optimization problem.