Glad you published this as I was confused about which path to take. Seeing complex items such as LLMs being built on top of general micro service architecture inspires me to create something with this technology.
A comparison of 2 extremes of microservice communication architecture: all-sync (layers) and all-async (silos), their structure, evolution, trade-offs, and the kind of rabbit holes they tend to push you into.