The fact that their now 1.5k token system prompt is forced into every response makes it not worth it, even though it's "unlimited". API makes a lot more sense for most purposes.
What does the 1.5K system prompt include? I'm surprised they don't use fine tuning for this aspect.
I'm guessing it's just a very long (and growing) list of things they aren't supposed to discuss and rules about the things they can.
If people used it for real things, instead of trying to assess its biases less of this kind of thing would be needed. I am not particularly concerned about the political views of a csv file.
Yeah, the main issue is if they are charging per token it's essentially them adding an extra fee per response, like a gas fee in Etherium. But thinking about it as an API is really strange, I don't expect an API to do anything but respond to my query yet LLMs act like an API that has to explain why it did (or didn't) do what you asked every time.
Someone reverse engineered it, I don't have a link handy. IIRC it was posted to HN recently.
Is the api without the system prompt? To use the API, you still need to have the subscription?
For OpenAI API you don't need the subscription. You put X amount of money and can use it until it's consumed.