You might still be tracked by device fingerprinting

https://en.wikipedia.org/wiki/Device_fingerprint

Also, I guess you'd have to make sure you used a VPN that didn't keep logs...