Hacker News Reader

Comment by christophilus | Hacker News Reader

SQLite is such an excellent little tool.

I recently ran an experiment with Node and was able to take writes from around 750 / second to around 24K / second just by coordinating them using Node IPC. That is, I had the main thread own the sole write connection and all other threads sent their writes operations to it, thread-local connections were read-only.

It's pretty cool how far you can push SQLite and it just keeps humming right along.

View on HN

Can you clarify "main thread"? Do you have a code example? Asking as Node is single threaded.

Thanks

Most likely using the cluster module and your favorite IPC module.

https://nodejs.org/api/cluster.html

That or https://nodejs.org/api/worker_threads.html#worker-threads

My go-to method of inter-process communication in Node without using any third party modules is to just use process.send[1] to a send a message to the main thread, and then have it forward messages to the workers in the cluster, which you can listen for using the message event [2].

[1] https://nodejs.org/api/process.html#processsendmessage-sendh...

[2] https://nodejs.org/api/process.html#event-message

Using cluster and worker threads. The code is here, but completely undocumented, as I’ve been side tracked by a few other things[0]. I’m currently looking into porting that project to Bun, so it’s possibly dead in its current form.

I was planning on turning that into a library, but Bun nerd sniped me.

You need the “hey” tool to run the benchmarks[1] the way that I was running them.

[0] https://github.com/chrisdavies/sql3

[1] https://github.com/rakyll/hey

Reply on news.ycombinator.com