If you believe that acceleration is critical, then you should be willing to take some sacrifices yourself in order to build or expand. If you start making exceptions, then you are saying that acceleration and growth itself is not inherently good, but only good in _some_ places when it impacts _some_ people.
You can apply this to literally anything. This argument is silly.
My point is that any project needs to properly balance the goals of the project with the freedom and autonomy of other people. This is not saying that the goals always triumph, or that autonomy always triumphs, but that there is a balance.
You asked what this has to do with e/acc -- if e/acc is claiming progress at all costs, build at all costs, but then imposes carve outs for the freedom/autonomy of only certain people (particularly it's adherents), it's a contradiction in the project.