Here is another perspective.

The web is already FULL of bad medical information. Older folks treat it as gospel already. All this technology does is make both good and bad information more accessible.

More importantly, there is NOTHING anyone can do to stop this. Nothing the US government can do will stop the proliferation of AI models that do everything including giving medical advice (or other things that we know it will screw up)

"Dr. P<hil>" is still on TV.

I take a pragmatic view on these things - assuming appeals to morality and ethics will fail, what do we do to educate people about this?