838 karma · joined March 25, 2019
Sadly Mistral does not support Ukrainian. I hope this changes! I expect better from a European model
The output quality is higher. It's held at full precision (not quantized).
I am using the PrismaAQUA
standard 9.7 t/s
+ Dflash2 30 t/s
+ torch-compile 37 t/s
c8 = 177 t/s
https://pplx-dgx-spark-lp-demo.pplx.app/
Looks very useful
update:
It advertises with local harness and models but its closed source and you need a pro or max account
You can probably create it yourself using an LLM, search and Elevenlabs.
https://rvembedded.com/products/project-lab/
Definitely interested!
We are all witnessing the start of an AI era that will not end soon. Guiderails are a part in this development. I do have questions about the people, or systems, that decide on what's good and bad behavior. This tech is used in any country in the world. As long as they are able to pay their subscription in dollars, someone is able to use it. Is it up to a company to decide what's good or bad behavior? Is this a debate? Is this politics? Is this just a vision of one company? Would it shift in time? Will it be stricter for more hyper-intelligent models? Will it change when open source models are becoming better and better?
OpenDuck takes a different approach with query federation with a gateway that splits execution across local and remote workers. My use case requires every node to serve reads independently with zero network latency, and to keep running if other nodes go down.
The PostgreSQL dependency for metadata feels heavy. Now you're operating two database systems instead of one. In my setup DuckDB stores both the Raft log and the application data, so there's a single storage engine to reason about.
Not saying my approach is universally better. If you need to query across datasets that don't fit on a single machine, OpenDuck's architecture makes more sense. But if you want replicated state with strong consistency, Raft + DuckDB works very well.
The key explorer let's you change data on the fly and receive notifications in real time when a condition is met (if value contains X).
It's build in Rust on bare metal wit isolation between clients and data.
ReplicaSafe.com (nothing there yet, will take a few weeks)
This is a new tech where I don't see a big future role for US tech. They blocked chips, so China built their own. They blocked the machines (ASML) so China built their own.
The website needs some love, but the webapp is going well.
They mean: You server will get connection timeouts through CloudFlare proxy