yes, it is, but if you only cross-match data from a single person, that's called conducting a (private) investigation, which is regularly done, that's absolutely legal...
However, it changes when you do that in an automated way, en masse, both ethically and legally.