The biggest amount of delta-v is necessary to leave Earth's gravity well. Once you're there, going from and to asteroid is time-consuming but doesn't need that much delta-v, moving ore from the asteroid to Earth would cost some fuel, proportional to the mass.
So moving it into orbit would save time but require us to pay for the fuel all at once.
So why should someone do this, unless you need a permanent human presence on the asteroid?