No, there is no global database. You just share hashes that you know about, so no matter how many hashes there is, IPFS will still be the same speed.