“I don’t think we’ve learned general principles yet about how to deal with human norms that you have to respect,”

That’s only in phase 1.

Afterwards when humans are outnumbered by vast bot swarms, and all their content and capital is vanishingly tiny, these norms won’t matter. Also, human participation won’t matter, and will likely be similar to the paralympics or women’s tennis (but orders of magnitude suckier).

Entertainment for a tiny niche of the market (humans performing for humans) will not be an economically significant space, kind of like classical music today or better yet renaissance music.

EVERYTHING you are used to online — including these comments - can already be convincingly deepfaked by adversarial networks trained on throwing bullshit at a wall and seeing what sticks. And this bullshit can actually be a superstimulus that outperforms genuine human interaction. What is missing is decentralized botnets swarming at scale to gradually and unrelentingly amass karma points across the swarm, and use them to move sentiment, markets etc. but that’s coming. Afterwards it’s onto subverting democratic systems with sybil attacks, as well as judicial systems with parallel construction and deepfake “evidence”.