They already have done all that:
hardware: https://www.96boards.org/
boot: https://github.com/ARM-software/arm-trusted-firmware
toolchain: http://releases.linaro.org/14.11/components/toolchain/binaries/
In particular, the ARM trusted firmware project is what is supposed to save us from todays proprietary boot madness