how does Vertex compare to GPT in terms of quality of output? Also do you use it as it is, or do any fine tuning?
1. text-bison limited to 1024 output tokens.
2. Output format we ask for JSON. But it is not valid json many times (, after last element, missing } after element etc). We have to write our own parsing code in the end to work around these JSON format issues.