one thing I love about DuckDB is that it supports Parquet files, which means you can get great compression on the data. Here's an examples getting a 1 million row CSV under 50mb and interactive querying in the browser:
https://observablehq.com/@observablehq/bandcamp-sales-data?c...
the other big thing is better native data types, especially dates. With SQLite if you want to work with timeseries you need to do your own date/time casting.