It is exactly like aptitude. The choice of packages could open you up to more vulnerabilities but homebrew itself shouldn't.
It's one of the first things I install whenever I reinstall my OS. That said if you're not doing dev I'm not sure what packages on it you are looking for?