Hacker News Reader

You can't stream SQLite files.

I'm not sure what you mean by "stream" here. However, there are two APIs designed to facilitate sending SQLite database files over a socket. The sqlite3_serialize() interface (https://www.sqlite.org/c3ref/serialize.html) takes a database and converts it into a blob of contiguous memory that can be sent over a wire. The sqlite3_deserialize() interface (https://www.sqlite.org/c3ref/deserialize.html) does the opposite, accepting a blob and using it as a database file. These interfaces were created for the purpose of "streaming" database files across network connections. Depending on your specific needs, they might work for you.

I'm assuming they mean some parts in the file require parts that appear farther on, so you'd have to receive the whole file?

> I'm not sure what you mean by "stream" here. However, there are two APIs designed to facilitate sending SQLite database files over a socket.

I already have APIs that send SQLite database files over a socket: send(), sendfile(), writev(), and so on.

What I don't have is the ability to receive SQLite database files incrementally (stream): I always need enough disk and/or memory to store an SQLite database.

I can however, receive an XLS file (or even XLSX) incrementally and implement a streaming parser for it.

Reply on news.ycombinator.com