Some (most?) flavors of anarchy eschew hierarchys, not rules in general. Eg. your local collective or union or guild (depending on your flavor of anarchy) would collectively decide "killing is wrong, here's what happens if someone does it".
I suppose this all comes back to the point that nobody is pragmatically advocating for absolute anarchy - it's simply a valuable concept to reference as we collaborate to build actual, functioning social systems. Or, at least, that's how I tend to think about it ¯\_(ツ)_/¯
Once hierarchies solve the issues they are born from, they cease to be necessary. Hence a government that permanently solves poverty and thus crime in the most common sense, eliminates the need for an authority to regulate interactions between individuals.
There will still be a non-zero amount of hierarchical order within social systems even if it doesn't come from the government.
I just wanted to elaborate (since I agree) on your point that Anarchy is "a valuable concept to reference as we collaborate to build actual, functioning social systems".
I won't exclude that Anarchy could eventually concretize though, who knows!
I tend to speak this way because I lean towards discussing near and mid-term futures as opposed to longer term ones in many conversations for a number of reasons.
I do this in part because I'm biased toward the now both subconsciously and out of pragmatism as a material being living in the present, but also largely because I find that other people I encounter tend to be even more that way and struggle to envision the longer-term possible that may require a number of intermediate steps.
Anyway, to our future, voluntarily!