Last I checked a few months ago, if you want to use a distribution's version of Go, you must install all later libraries as root - there's no place for "my local libraries".
If you install Go the way golang.org instructions indicate, you can install everything as a non-root user just fine.