You could audit the Go source and then use the diverse double compiling technique[0] to verify that the binary you're using corresponds to that source code.
[0] http://www.dwheeler.com/trusting-trust/dissertation/html/whe...
[0] http://www.dwheeler.com/trusting-trust/dissertation/html/whe...