Nope. If you colocate hardware which you own (which is what colocation means), then they can't just go get your hardware. Even if they break the law and nab your hardware, you'll know because it's down.
With VPSes, they can get your data and you might never know. It's an extremely important distinction.