The term you're looking for is reproducible builds and it's unfortunately not trivial and a somewhat rare state of affairs. It's definitely crucial in the long run.