>> I wonder what would be required to build a model that explores the search space of compilable programs in say python that sorts in correct order.

Oh, not that much. You could do that easily with a small computer and an infinite amount of time.