Moreover, "moving data around in memory can be very time-consuming" means that in the end, it is still about time, not about memory.
So the correct way would be to translate memory access to time, but that means modelling the memory hierarchy, modelling caches in general, and finally perhaps modelling the specifically used caching strategies.