Tangential: you can finetune something like flan-ul2 to do quote extraction using examples generated from chatgpt. If you have a good enough GPU, it should help cut down costs significantly
Again though, it's the zero-effort part that's appealing. I'm on a very small team and getting that to close to the same standard will take time for a ham-fisted clod like myself. Worth giving a shot all the same though, thanks again.
Also, running your own specialized model locally can be much faster than using someone’s API.
I think we're not far off having something equivalent that can be pulled from Huggingface and run on a near consumer grade GPU.
For now, I'll hang tight and see how things progress. Don't disagree.
But yea, they cheap cost and lack of training is making me a take a long hard look at how I'm implementing more traditional NLP solutions.
you mean this? "Data submitted through the API is no longer used for service improvements (including model training) unless the organization opts in" https://openai.com/blog/introducing-chatgpt-and-whisper-apis
I think I missed the exception for API, how ever not sure where they are, but seems to be fine based on alpaca. Also interesting they are so hard on web scraping and and extraction, lol. But wow, that is a poorly worded paragraph.