zombiezen.com/go/sqlite is built on top of modernc.org/sqlite, so also has the same properties.
(OP here) Honestly, me too. Maybe it has to do with leaving out that database/sql driver layer. I guess it would need another round of pprof to find out the real reason.