Much of this is captured extremely well in Fowler's The New Methodology.

https://martinfowler.com/articles/newMethodology.html