IIRC the main reason here is that brew path is hardcoded during the build process of packages, which means that you wouldn't be able to use bottles.
I didn't check, but there is a chance that path is also hardcoded in (some) formulae, so even building from the source might not help here.