Obviously it is none of my business how people read their manpages, but on the off chance this may be useful to you:

    export LESS='--mouse --wheel-lines=3'

You mean that you can't scroll in the terminal, or?