This interests me. Can you elaborate on what downsides you see? Even in a small team we're often working within the same repo at the same time without any issues.
I think it's a great way for start up to manage the business but as more people get hired the organizational complexity might be too much to bear.