I have also used it. I switched once homebrew installed conflicting versions of OpenSSL and wasted weeks of time trying to get both MySQL and vim working at the same time.
It is rough around the edges as some packages are missing if I remember right.
I too only used pkgsrc when I had a Mac developer machine. Afaik mostly because of their superior dependency management.