You can self host something like https://big-agi.com/ and grab your own keys from various providers. You end up with the above, but without the pitfalls you mentioned.
The also support an application development framework that looks interesting but I have never used it.