Since when? I just tested it, and I can process a 1gb CSV file on my machine using the csv module in Python in ~10 seconds. My machine isn't a world record setting machine, either.
I tried reading 1GB CSV and add all the rows into Sqlite, and it definitely takes minutes. This happens to both JS and python.
Constructing a giant INSERT should already exceed 1 minutes (or transforming any 1gb-sized string).
Would you mind sharing your Python snippet?
.mode csv
.import filename.csv table_name
So not 10 seconds but no need to create an insert statement (I'm sure you can access this functionality from python if you need to)
Superintendent uses the same approach (i.e. use the CSV extension).
But I don't think we should call that python ... since it essentially just calls C code in Sqlite.