A VM is not the best environment to test speed and compare it to a native environment speed.
I noticed that certain operations take longer on a VM, and e.g. disk performance may differ a lot (and sometimes be faster than the host FS's!)
Also, things being in the page cache can speed up the second and subsequent runs much faster.