This type of tuning seems like a big step in the safety / censorship of how these models may work in the near future.
I already have a hard time trusting ChatGPT, etc., but mostly for factual-accuracy reasons.
The potential for LLMs to be tuned to give me responses that I'm likely to like (or manipulate me to buy something) is truly unfortunate.
Advertising: why we can't have nice things.