ClickHouse to Serve Real-Time Queries on Top of BigQuery Data

When I tested BigQuery for ClickBench, the minimum query latency was 0.5 seconds. However, there is some feature for better query latency (need to check).

Note: BigQuery has a "De-Witt" clause[2] that prevents publishing the benchmark results. That's why there are all the testing instructions, but no published results: https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d...

Nevertheless, BigQuery is good for long-running queries, as the number of query workers is selected dynamically on a per-query basis.

[1] ClickBench: https://github.com/ClickHouse/ClickBench/ [2] https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d...

It's a shame that ClickHouse Inc has not tried to solve the operational complexity of doing this. You might get some performance out of your queries, but at the cost of adding a bunch of new tools & infrastructure just so you can duplicate some data into yet another database. If all you offer is faster SQL, its a tough trade off to make.

I am looking forward to reading more about how ClickHouse is being used with BigQuery