A decent training pipeline will be able to reproduce models with equivalent aggregate performance (as measured by the evaluation metrics). And a high degree of similarity in behavior on specific inputs - but not identical.
It will not be the same exact weights. But that is not a critical bar to reach. And may software builds also fails that bar.