Google released PaLM pricing per character at $0.0005/1k (for chat, instruct is 0.001).
With OpenAI tokens at approx 4 chars per token, this matches $0.002/1k tokens for 3.5.
Let's hope OpenAI retaliate, cut prices to maintain market share and start a happy race to the bottom/affordable genAI for users.
How do we know which one is objectively better?
Is Google’s history of shutting down projects now about to bite them because people will be hesitant to invest in an api framework that may go poof ?
In my experience it's not as good as even GPT-3.5 at following instructions (for example formatting a text blob into structured json) which leads it have too much variability in output to be useful.
Have recently been working with it as well and come to the same conclusion. Would be nice to use it since my company is already a GCP shop, but the json parsing is super frustrating. I have noticed using Python's ast.literal_eval helps, since it catches single quotes.