At root, philosophically (as opposed to practically), are you not describing this: A Pattern Language, Christoper Alexander, 1977, https://en.m.wikipedia.org/wiki/A_Pattern_Language
Yes, it’s not as blocky and snap-together as Lego, but I always considered that an artifact of the need for adaptability/evolution, flexibility to allow things to fit into environments of random complexity, and accommodating a wide array of human preferences.
“Programming”, like architecture/planning of the physical environment, seems to have turned out to need this degree of granularity, nearly indistinguishable from an organic system.