HNHacker News
TopNewBestAskShowJobs

ZiliangXK

5 karma · joined January 3, 2023

submissionscomments
ZiliangXK··on Streaming SQL for Real-Time AI and Machine Learning
any blogs i can reference and compare to other solutions, what are the key differentiations ?
ZiliangXK··on Streaming SQL for Real-Time AI and Machine Learning
What are the real-use cases and pain points Timeplus solves in AI / ML ?
ZiliangXK··on Show HN: Open-Source C++ Apache Iceberg Client with Write Support
Look like other folks are doing similar things, wondering any benchmark results so far compared with Java implementation
ZiliangXK··on Reliably replicating data between Postgres and ClickHouse
This is exactly a use case a streaming processing like Timeplus excels, which help users do 20s streaming to dynamic table joins (imagine the hand side tables are dynamically updates) to denormalize data before the data lands in ClickHouse. This helps a lot for warehouse like ClickHouse to save the joins in them. Disclaimer, I am one of the Timepluer core engine engineer.
ZiliangXK··on Feldera Incremental Compute Engine
There is always a tipping point for quite a few use cases where incremental evaluation degrades perf compared with full batch / historical query ?
ZiliangXK··on Feldera Incremental Compute Engine
Timeplus proton OSS https://github.com/timeplus-io/proton does similar thing but with powerful historical query processing as well.
ZiliangXK··on Proton, a fast and lightweight alternative to Apache Flink
table engines and need compile into the single binary instead of .so
ZiliangXK··on Proton, a fast and lightweight alternative to Apache Flink
Flink is used quite a lot in prod in global and there are so many gems in it as well regarding streaming processing and it is still probably state of the art in streaming processing. Timeplus Proton stands on the giant shoulders (Flink is definitely one of them), and tries to provide an easier / more resource efficient solution via (ClickHouse) database technologies. PS, I am one of the contributors of Timeplus Proton, so could be biased.
ZiliangXK··on Proton, a fast and lightweight alternative to Apache Flink
(PS I am one of the contributors of Timeplus Proton. What I said could be biased.) Thanks for the feedbacks and they totally make sense. We will definitely work on the README, FAQ etc to make key use cases etc more explicit.

A very typical scenario is live query / analysis data in Kafka topics with Proton Streaming SQL and materialize the processed / aggregated results to a downstream system like ClickHouse or a target Kafka topic. What we need to do is 1. curl download the binary 2. create an external stream to point to your Kafka topic 3. run the streaming SQL.