Can you please elaborate on why you think BigQuery's streaming inserts are not particularly reliable?
Separately, you can always use BigQuery's federated query capability of Bigtable.
(work at G)
Separately, you can always use BigQuery's federated query capability of Bigtable.
(work at G)
I've heard this from many users through my work on Fluentd (in fact, many end up using fluent-plugin-bigquery because they don't want to deal with the minutiae of insertId and whatnot on their own).
Also, I don't think a lot of people fully understand the quota policy and get tripped up: https://cloud.google.com/bigquery/quota-policy
>Separately, you can always use BigQuery's federated query capability of Bigtable.
Yes, and very few people understand what that means (I had to look up, and I am reasonably educated on GCP). This is not necessarily product shortcomings but packaging deficiencies that can be addressed with better product marketing.