4,022 karma · joined September 30, 2014
[1]: https://juliaearth.github.io/GeoStatsDocs/stable/domains.htm...
[2]: https://geopandas.org/en/stable/docs/user_guide/set_operatio...
You can use the Hugging Face Inference API or your own HTTP endpoint, provided it adheres to the API specified here[1] or here[2]."
It's fairly easy to use your own model locally with the plugin. You can just use the one of the community developed inference servers, which are listed at the bottom of the page, but here's the links[3] to both[4].
[1]: https://huggingface.co/docs/api-inference/detailed_parameter...
[2]: https://huggingface.github.io/text-generation-inference/#/Te...
[3]: https://github.com/wangcx18/llm-vscode-inference-server
[4]: https://github.com/wangcx18/llm-vscode-inference-server
Edit: Hmmm, worked when I signed up with a different email.
Note that you must be registered in the NVIDIA Developer Program to apply for the early access release. You must also be logged in using your organization’s email address. We cannot accept applications from accounts using Gmail, Yahoo, QQ, or other personal email accounts."
Okay, kind of a bummer.
One of the huge benefits I see with Postgres is its extension system. PostGIS is amazing. Can save any company that needs to do heavy geospatial processing $$$ by dodging ESRI. The only database I've found that handles geospatial stuff better is BigQuery, but considering the revolution that was Google Maps over the best decade I don't think that would really surprise anyone.
"We present Position Interpolation (PI) that extends the context window sizes of RoPE-based pretrained LLMs such as LLaMA models to up to 32768 with minimal fine-tuning (within 1000 steps), while demonstrating strong empirical results on various tasks that require long context, including passkey retrieval, language modeling, and long document summarization from LLaMA 7B to 65B. Meanwhile, the extended model by Position Interpolation preserve quality relatively well on tasks within its original context window. To achieve this goal, Position Interpolation linearly down-scales the input position indices to match the original context window size, rather than extrapolating beyond the trained context length which may lead to catastrophically high attention scores that completely ruin the self-attention mechanism. Our theoretical study shows that the upper bound of interpolation is at least ∼600× smaller than that of extrapolation, further demonstrating its stability. Models extended via Position Interpolation retain its original architecture and can reuse most pre-existing optimization and infrastructure."
This is a pretty wild result. Almost all of the open source models folks have been using from HF etc can suddenly easily be extended to have an enormous context window for little to no effort. You can already see these models being distributed in the most popular formats for inference, like GGML, on The Bloke's HuggingFace profile!
This is exactly the kind of thing I'd love to see added to the server, so that finding the information in the massive chat channels I needed was easier and could be distributed to others.
If any Struct folks are around, the game is called BattleBit. The devs might be happy to hear from you!