Hacker News Reader

> just go wild with CLI programs, I know dozens that work on CSV and XML

...or put it into SQLite for extra blazing fastness! No kidding.

That's included in CLI tools. Also duckdb and clickhouse-local are amazing.

I need to learn more about the latter for some log processing...

Log files aren’t data. That’s your first problem. But that’s the only thing that most people have that generates more bytes than can fit on screen in a single spreadsheet.

Of course they are. They just aren't always structured nicely.

Everything is data if you are brave enough.

clickhouse-local had been astonishingly fast for operating on many GB of local CSVs.

I had a heck of a time running the server locally before I discovered the CLI.

Reply on news.ycombinator.com