> That means there was enough information in the ciphertext for the server to perform the inference

The server doesn’t need any information to perform inference.