stergiotis

Impressive, love it, many thanks!

CedrarDB [0] (commercialization of Umbra [1] research DB) would be an interesting contender. The group creating Umbra researches on JSON representations in column stores, see [2].

[0] https://cedardb.com/ (commerciUmbra) [1] https://umbra-db.com/ [2] https://db.in.tum.de/~durner/papers/json-tiles-sigmod21.pdf

You are exactly right! There does not seem to be much out there. I usually do hash or otherwise transform real-world (e.g., https://github.com/awesomedata/awesome-public-datasets) data to retain basic properties like skewness utf8 well-formedness, cardinality, and such. Like many others, I often use the Enron eMail dataset, NYC Taxi, or Twitter data (for coherent use of Unicode). And then scale it either by combining attributes randomly or otherwise augmenting it. Earlier in my career, I wrote a regular expression inversion data generator; it quickly spiraled out of control complexity-wise ;-).

Judging from the documentation datasino is easily the best data generator I ever came across! I will definitively give it a spin. Love your tech-stack: S-Expr, ClickHouse RowBinary, Kafka, nix and Ocaml. A man of culture!