If you're paying to use the model that means instead of paying content creators you're also now giving more content to the model for free.

Also just like SEO to game search engines, "democratized RLHF" has big trust issues.