Yes but we could could look at the amount of of data transmitted in total. Audio compression is well understood, and can infer within an range of usable quality, if any excess voice or other data is sent over the network.
Now, there is some security basis
http://www.cs.unc.edu/~fabian/papers/tissec2010.pdf
>Uncovering Spoken Phrases in Encrypted Voice over IP Conversations