It's not pronounced "of", it's more like "ev", exactly like the contraction of words it's made up of. Would have.
That's when I gave up. There are a million other reasons to love my wife, and her proper use of 'would've' wasn't one of them to begin with :)
If I said "would ev" that would sound weird. It would sound very similar to "whatev":