I get why that’s unsatisfying from the user perspective, but it’s absolutely necessary from the perspective of maintaining user trust over time. Signal has a plan to fix it but we’ll have to see if they can actually implement their new groups solution.
I can assure you that large secure groups with strong cryptographic guarantees and evolving membership lists is unsolved.
I'm not talking about wanting to make the kinds of groups with dynamic membership like you're talking about.
https://github.com/signalapp/Signal-Android/issues/8571
The bug is my only real complaint with Signal's group messaging system.
EDIT: I should note that the bug was opened in January of 2019 (although existed for much longer than that) and as of December 2019 it was still in ongoing problem for some users.
I elaborated in responding to another user.