Re (2): GPT4 requires engineering for resiliency. The API (currently) has availability issues and high variance in latency. It’s not (yet) ready for interactive use. For other use cases, a good queuing and retry strategy is necessary.
No comments yet.