DuckDB and other specialized DBs benefit from much more optimized math, data structures and data storage/ memory lookups I'd assume.

But a 5x increase simply by optimizing the planner is nothing to be ashamed of.