When a business has leverage over your livelihood, it's easily abusable. It's not as simple as saying "no" when the consequences include your family losing their home. This is why OSHA is so great, it rightly shifts the liability from the employee to the employer who is running the job and telling the workers what to do.