Google, Microsoft, Netflix & Facebook benefit directly from H1B visas and are most certainly not "sweatshops". Even when you consider companies that pay less than the top tech companies, no one would consider them sweatshops. So hyperbole aside, and keeping in mind that H1B also brings academic talent to universities, the hate towards the H1B program seems more rooted in a hate of immigration than a worry of the program not realizing its "original intent".
If you don't want 85,000 of the best talent in the world per year to power US companies' and academia's growth, that's fine. Go ahead and limit the visa program and risk that talent going elsewhere.