The company can very well fire you if you do this, since DOL does not consider commute time from home to the designated/required work site to be working hours: https://www.dol.gov/general/topic/workhours/traveltime
It's a shame that's the way it is -- but it places the onus on the employer. They would have to fire you, and bear the cost of replacing you.