How do you associate the imsi with any other type of data?
For example, set up your IMSI catcher next to a numberplate reader. If you repeatedly see a particular IMSI at the same time as a particular numberplate, then there's a fair chance that that phone travels with that car, and therefore that it likely belongs to the driver of the car.
This is easily automated on a large scale, and if anything gets easier as the scale gets larger as you get more data points.
Am I wrong?