Hacker News Reader

I'm waiting for them to support BigQuery and Snowflake with the same pushdown capabilities. Hope it doesn't end up in their cloud offering!

View on HN

I have been wondering how to support interactive / real-time web apps based on Snowflake data. I suppose pushing down to DuckDB a subset of data needed for a chart would be one way to do this...

If you’re pushing down the data, you’re losing the real-time capability no?

If you want fast, adhoc, real-time querying, load the data as it’s created directly into duckdb or clickhouse. Now you’ll have sub-100ms responses for most of your queries.

I'd assume they mean users interacting with the chart vs first load. So the user sees the base chart (Let's say 1MB of data on the server, less depending what gets pushed to the user) and then additional filters, aggregations, etc. are pretty cheap because the server has a local copy to query against

Yes -- sorry, I meant exactly the above.

isn't there a postgres compatibility layer in BigQuery? shouldn't that then work with the duckdb-postgres compatibility ?

You're probably thinking of Spanner, not BigQuery

Reply on news.ycombinator.com