As you said,
"While you can't be 100 percent sure of the reliability of RdRand because you can't audit it"
So, if you are willing to disregard the importance of auditing a (critical!) piece of code, and take and use a nice black box given to you by that big company, then it begs the question.... Why on earth are you using open source??
It just makes no sense. To me, at least.