Hacker News Reader

It's definitely a fun dataset to explore.

Dale from ClickHouse wrote a pretty extensive blog series on the Hacker News dataset, ingest approach, some queries of interest...

Could be a good bit of reading alongside the project?

https://clickhouse.com/blog/getting-data-into-clickhouse-par...

tylerhannanon Don’t throw out those used coffee grounds–use them for 3D printing instead

Given that composting isn't really a thing in our city...this is compelling.

Perhaps it is the best excuse to get into 3d printing? ;)

tylerhannanon Android 14 adds support for using your smartphone as a webcam

finally!

tylerhannanon Is ClickHouse Moving Away from Open Source?

also clickhouse-local exists...https://clickhouse.com/docs/en/operations/utilities/clickhou...

FWIW, you can checkout clickbench.com is a benchmark of parquet, partitioned of ClickHouse and DuckDB

tylerhannanon GitHub profile achievements

We are lucky to have him. It also helps that he was the founding engineer on the product.

Also, feel free to hit us up in GH (or we have a Slack). ClickHouse is used for a number of dashboarding implementations. It should work...but, as always, proof is in the testing.

Good luck! (and OMG, a better insights tab would make me a happy human)

tylerhannanon GitHub profile achievements

That would be https://news.ycombinator.com/user?id=zX41ZdbW

https://github.com/ClickHouse/github-explorer

tylerhannanon Show HN: Building musical synthesizers with SQL queries

I tend to open, and play, with https://github.com/VCVRack/Rack daily...

I haven't in the last few as I make horrific noises with SQL instead ;)

tylerhannanon Building ClickHouse Cloud from scratch in a year

Having also spent time at a GraphQL company, I keep expecting this question too ;)

But, as of yet, it has not come up.

tylerhannanon DPReview.com to close

DPReview has been a constant companion for the photography nerd for a LONG time now. It will be missed.

tylerhannanon MySQL for Developers

Starting here is probably useful...

https://learn.clickhouse.com/visitor_catalog_class/show/9134...

But there is quite a bit on learn.clickhouse ;) And if something is missing, tell us.

tylerhannanon Build Your Own Redis with C/C++

I sort of want, one day, to read the same article targeted at Delphi or Turbo Pascal. lol.

tylerhannanon Pgwarehouse: Easily sync your Postgres db to a Snowflake or ClickHouse warehouse

Super interesting, I look forward to playing with it.

FWIW, the Community Integrations section of https://clickhouse.com/docs/en/integrations is open for PRs if you want to add it ;)

tylerhannanon Category Theory Illustrated

Even in the late 90s when I was studying Topology there was a bit of furor over the lack of application...

Until, suddenly, it was quite applicable in evolutionary biology and knot theory in context of D?NA enzymes.

tylerhannanon Analyzing multi-gigabyte JSON files locally

There was an interesting article on this recently...

https://news.ycombinator.com/item?id=31004563

It prompted quite some conversation and discussion and, in the end, an updated benchmark across a variety of tools https://colab.research.google.com/github/dcmoura/spyql/blob/... conveniently right in the 10GB dataset size.

tylerhannanon Tracking the Fake GitHub Star Black Market

I love the edit in GH. So much.

Thank you for the work you do and for how much you have contributed to people learning over the years. <3

tylerhannanon LibSQL is a fork of SQLite that is both Open Source, and Open Contributions

I had always understood SQLite to be open source...I didn't realise it was more public domain than licensed.

So, to summarise, the goal of this project (beyond what is stated about futures) is to fork, apply an understood license vs. a blessing, and then open for contribution? Am I reading that correctly?

interesting!

tylerhannanon The text density-based Go crawler

very interesting...

I can't quite grok what is going on, but referencing the paper gives a great starting point. Thank you.

In particular the notion of a DensitySum seems novel and worth exploring.

(for others, http://www.ofey.me/papers/cetd-sigir11.pdf)

tylerhannanon Heroku Status – Dashboard/API Offline

Is there something different in the configuration that would cause the impact of Virginia vs. Ohio?

tylerhannanon [dead]

This blog post will describe how we built ClickHouse Cloud from the ground up. We delve into our planning process, design and architecture decisions, security and compliance considerations, how we achieved global scalability and reliability in the cloud, and some lessons we learned along the way.

tylerhannanon [dead]

It has been incredibly gratifying to participate in and watch this process.

This post describes a number of our thought processes and design decisions. Questions are, of course, welcome.

(Sidenote: I look after DevRel at ClickHouse)

tylerhannanon Show HN: I Scraped Hacker News for TLD Popularity

Thanks zX41zdbW - I find the query you shared easier to reason about than:

https://github.com/klausbreyer/hackernewsstats/blob/main/que...

Also:

"Elapsed: 0.140 sec, read 33.95 million rows, 1.26 GB."

140 ms is quite impressive.

tylerhannanon Show HN: Location based querying on your phone with almost any dataset

Super interesting. Excited to see where it gets.

Also I’m at ClickHouse. ;)

tylerhannanon DuckDB 0.7.0

It's an interesting question... DuckDB is a library. Just like SQLite is a library.

It's not designed for concurrent queries, clients connecting to a database, etc. I know there will be companies built around that problem space.

If "serverless" database is a thing, is there a category of software that is "production-less"? :)

(The above is a joke, lol.)

tylerhannanon Clog: Making a homegrown ClickHouse log for $20 a month

As someone who has worked at both companies (and is at ClickHouse presently), this -- to me -- is the best line I've read this week:

"and honestly the defaults for CH just... work whereas ES ends up needing a hundred dials slightly tweaked to make it work (and keep working)."

And yeah, that requires an immense amount of focus and effort. Glad you noticed. <3

tylerhannanon Big data is dead

One great reason to use DuckDB was when ClickHouse took up too much memory on Parquet files.

https://github.com/ClickHouse/ClickHouse/issues/45741#issuec... helps with that though.

Also, clickhouse-local exists https://clickhouse.com/blog/extracting-converting-querying-l... as a thing.

But, yes, when I think of DuckDB...I think embedded use cases...i'm also not a power user.

I also think of this very much as a 'horses for courses' or 'different strokes, different folks' sort of scenario. There is, naturally, overlap because 'analytical data.' But also, there is naturally overlap with R and this giant scary mess of data-munging PERL code I maintain for a side project.

The DuckDB team, the MotherDuck team, the ClickHouse team...we all want your experience interacting with data to be amazing. In some scenarios, ClickHouse is better. In some scenarios, DuckDB. I'm biased (as I work for ClickHouse in DevRel), but I <3 ClickHouse.

Try both. Pick the one that is best for you. Then...you know...tell the other(s) why so that we all can get better at what we do.

tylerhannanon ClickHouse Cloud is now Generally Available

If you have questions...do feel free to shout.

tylerhannanon ClickHouse Cloud is now in Public Beta

And https://clickhouse.com/docs/en/intro/ is a bit lower level.

tylerhannanon ClickHouse Cloud is now in Public Beta

Thanks for the well wishes!

And thanks for the honest feedback.

It's always an interesting balance of promoting a new thing (Cloud) and explaining an existing thing. This might be helpful.

https://clickhouse.com/docs/en/home

(note: I work at ClickHouse)

tylerhannanon ClickHouse Cloud is now in Public Beta