I take fairly to mean less than pretty. Oh somewhat like "ok." or the newer word "meh."

Tone of voice and situation sometimes counts though.

In order:

fairly > pretty > [the word] > very