Acidity causes things to taste sour, not bitter. Bitterness is associated with alkaloids (many alkaloids are poisonous, so the fact we have taste-buds for bitterness is an advantage).

I experience lemons as both sweet and sour, but certainly not bitter.

[Edit] Perhaps the peel is bitter; the white pulp is certainly bitter.