Hacker News Reader

hfmuehleisenon Quack: The DuckDB Client-Server Protocol

Maintainer here. Yes!

hfmuehleisenon DuckDB NPM packages 1.3.3 and 1.29.2 compromised with malware

they have now removed the affected versions!

hfmuehleisenon DuckDB NPM packages 1.3.3 and 1.29.2 compromised with malware

Yes we tried, but npm would not let us because of "dependencies". We've reached out to them and are waiting for a response. In the meantime, we re-published the packages with newer versions so people won't accidentally install the compromised version.

hfmuehleisenon DuckDB NPM packages 1.3.3 and 1.29.2 compromised with malware

DuckDB maintainer here, thanks for flagging this. Indeed the npm stats are delayed. We will know in a day or so what the actual count was. In the meantime, I've removed that statement.

hfmuehleisenon The DuckDB Local UI

SSH port forwarding?

hfmuehleisenon DuckDB 0.7.0

Yes we are working on it

hfmuehleisenon Friendlier SQL with DuckDB

It does, DuckDB supports recursive CTEs

hfmuehleisenon Parallel Grouped Aggregation in DuckDB

DuckDB also works fine with R data frames so there is really no downside to using R in this case

hfmuehleisenon DuckDB quacks Arrow: A zero-copy data integration between Arrow and DuckDB

DuckDB has its own Parquet reader

hfmuehleisenon Hosting SQLite databases on GitHub Pages or any static file hoster

DuckDB can directly & selectively query Parquet files over HTTP/S3 as well. See here for examples: https://github.com/duckdb/duckdb/blob/6c7c9805fdf1604039ebed...

hfmuehleisenon What's New in SQLite 3.35

One of the DuckDB authors here. Can you open an issue wrt the import problem? Should not happen. Try setting a database file and a memory limit.

hfmuehleisenon DuckDB – An embeddable SQL database like SQLite, but supports Postgres features

Yes, DuckDB has strict typing.

hfmuehleisenon DuckDB – An embeddable SQL database like SQLite, but supports Postgres features

One of the DuckDB authors here. The answer is yes, but only in read-only mode at the same time.

hfmuehleisenon DuckDB – An embeddable SQL database like SQLite, but supports Postgres features

Another DuckDB developer here, we support reading table data from Parquet files directly.

hfmuehleisenon DuckDB: SQLite for Analytics

Hi, one of the authors of DuckDB here.

ad 1) An index is an additional data structure that takes space and needs maintenance when the data changes. This is especially problematic for realtime data. DuckDBs main data structure and implementation is designed for efficient scanning without needing an additional index ("vectorised columnar").

ad 2) We support STDDEV_SAMP and STDDEV_POP. There is also an interface to define your own functions. We are very aware of how SQLite is doing things and even support their client API. But we also might eventually add their way of adding UDFs from Python.

hfmuehleisenon Is GPU Database a Hype?

The crux here is the transfer of data into the very limited RAM of the GPU. If the data is already conveniently placed on the GPU, they are indeed thousands of time faster. But this is mostly a situation that is artificially created for benchmarks. If the transfer is taken into account, usually CPU-based systems win.

Database query processing (SQL) usually requires a very low amount of compute cycles per byte of data (e.g. filter, hash table builds, ...), which means that the GPU cannot really take advantage of its compute power.

For ML this is a very different situation, lots of compute on few bytes, which is why we see GPUs and TPUs seriously being used there.

hfmuehleisenon MonetDB – Column-store database

Martin Kersten recently got the SIGMOD systems award for MonetDB: http://sigmod.org/sigmod-awards/people/martin-kersten-2016-s...

hfmuehleisenon MonetDB – Column-store database

Sorry to hear that! We have recently overhauled the CSV importer and added a "BEST EFFORT" flag to it. Perhaps its time to try again?

hfmuehleisenon MonetDB – Column-store database

Could you be more specific? What went wrong?

hfmuehleisenon Poll: What database does your company/you use?

MonetDB

hfmuehleisenon PostgreSQL Columnar Store for Analytic Workloads

I have written a short blog post on how CitusDB's column store compares with purpose-built systems such as MonetDB. Repeatability ftw. Disclosure: I am part of the MonetDB development team.

CitusDB vs. MonetDB TPC-H Shootout http://www.monetdb.org/content/citusdb-postgresql-column-sto...