If you have the RAM to load up a toy dataset, what happens if you utilize a :memory: database instead of disk? If the performance is the same, you know the problem exists outside of the storage.