That's why we love ClickHouse, the fastest and most lightweight approach for real-time analytics. Furthermore, data stream processing should also uphold these same principles, without unnecessary complexity.
With Timeplus Proton - a single-binary, fast and efficient streaming processing engine, ClickHouse users can now natively and effortlessly utilize SQL queries and Materialized Views to enable fast and scalable incremental streaming processing from Kafka or any other data stream source, turbocharging broader real-time streaming analytics use cases such as data stream pipelines, unified online/offline ML features, infrastructure monitoring, or any other latency-sensitive applications.
Proton is an open-source streaming processor, written in C++. We’re thrilled to introduce a major upgrade of Proton, which you can now read or write ClickHouse with streaming SQL. You can use Proton as a lightweight streaming processor to get live data from Kafka/Redpanda, apply simple or complex processing logic, then send data to your ClickHouse, no matter in local or in the cloud. You can also JOIN Kafka data with dimensional data in ClickHouse, without moving them to Proton.
I wrote this tutorial to share how to get started using Proton and ClickHouse together. Demo video included. Happy to discuss here.